Aug 05 15:40:43 devstack cinder-volume[77622]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:40:43 devstack cinder-volume[77622]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:40:43 devstack cinder-volume[77622]: we strongly recommend against using it for new projects. Aug 05 15:40:43 devstack cinder-volume[77622]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:40:43 devstack cinder-volume[77622]: framework. For more detail see Aug 05 15:40:43 devstack cinder-volume[77622]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:40:43 devstack cinder-volume[77622]: import eventlet # noqa Aug 05 15:40:45 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:40:45 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:40:45 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:40:46 devstack cinder-volume[77622]: INFO dbcounter [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Registered counter for database cinder Aug 05 15:40:46 devstack cinder-volume[77622]: DEBUG oslo_db.sqlalchemy.engines [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG dbcounter [-] [77622] Writer thread running {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.rpc [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.rpc [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_db.sqlalchemy.engines [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.volume.manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Determined volume DB was empty at startup. Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG cinder.volume.manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77622) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.volume.manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 15:40:47 devstack cinder-volume[77622]: WARNING stevedore.named [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:40:47 devstack cinder-volume[77622]: WARNING castellan.key_manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:40:47 devstack cinder-volume[77622]: WARNING cinder.keymgr.conf_key_mgr [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG cinder.volume.drivers.lvm [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77622) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_concurrency.processutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_concurrency.processutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=77622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_db.sqlalchemy.engines [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.rpc [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.rpc [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 05 15:40:47 devstack cinder-volume[77622]: WARNING stevedore.named [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:40:47 devstack cinder-volume[77622]: WARNING castellan.key_manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:40:47 devstack cinder-volume[77622]: INFO cinder.volume.manager [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_db.sqlalchemy.engines [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:40:47 devstack cinder-volume[77622]: INFO oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Starting 1 workers Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Started child 77779 {{(pid=77622) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Full set of CONF: {{(pid=77622) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] ******************************************************************************** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Configuration options gathered from: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] ================================================================================ {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:40:47 devstack cinder-volume[77779]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] allow_availability_zone_fallback = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] allow_compression_on_image_upload = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] allowed_direct_url_schemes = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] api_rate_limit = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] auth_strategy = keystone {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] az_cache_duration = 3600 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_availability_zone = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_host = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_stats_polling_interval = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backup_api_class = cinder.backup.api.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backup_name_template = backup-%s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backup_use_same_host = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backup_use_temp_snapshot = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] chap_password = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] chap_username = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_internal_tenant_project_id = 371f8ab0e6c84e81987027c987d113d9 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_internal_tenant_user_id = e39b2ca7d5c4433d97c02e48c2105e65 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cloned_volume_same_az = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cluster = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] compression_format = gzip {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] compute_api_class = cinder.compute.nova.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] config_dir = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] config_source = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] control_exchange = openstack {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] debug = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] default_availability_zone = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] default_group_type = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] default_volume_type = lvmdriver-1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] disk_geometry = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_client_cert = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_client_cert_key = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_data_namespace = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_ssl_cert_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_ssl_cert_verify = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] driver_use_ssl = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] enable_force_upload = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] enable_new_services = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] enable_unsupported_driver = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] enabled_backends = ['lvmdriver-1'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:47 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] enforce_multipath_for_image_xfer = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] filter_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_api_insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_api_ssl_compression = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_ca_certificates_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_catalog_info = image:glance:publicURL {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_num_retries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance_request_timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] goodness_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] graceful_shutdown_timeout = 5 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] group_api_class = cinder.group.api.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] host = devstack {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_compress_on_upload = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_conversion_address_space_limit = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_conversion_cpu_limit = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77779]: INFO cinder.volume.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_conversion_disable = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_upload_use_cinder_backend = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_upload_use_internal_tenant = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_volume_cache_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_volume_cache_max_count = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] image_volume_cache_max_size_gb = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] init_host_max_objects_retrieval = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] instance_format = [instance: %(uuid)s] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iscsi_target_flags = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iscsi_write_cache = on {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iser_helper = tgtadm {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iser_ip_address = 192.168.122.154 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iser_port = 3260 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_color = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_config_append = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_dir = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_options = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_rotate_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_rotate_interval_type = days {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] log_rotation_type = none {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] max_age = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] max_logfile_count = 30 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] max_logfile_size_mb = 200 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] max_over_subscription_ratio = 20.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] message_reap_interval = 86400 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] message_ttl = 2592000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] migration_create_volume_timeout_secs = 300 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] monkey_patch = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] monkey_patch_modules = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] my_ip = 192.168.122.154 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] no_snapshot_gb_quota = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] num_iser_scan_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] num_shell_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] num_volume_device_scan_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] nvmeof_conn_info_version = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] nvmet_ns_id = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] nvmet_port_id = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_max_limit = 1000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_ext_list = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_listen_port = 8776 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_use_ssl = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] osapi_volume_workers = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] per_volume_size_limit = -1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] periodic_fuzzy_delay = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] periodic_interval = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] public_endpoint = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] publish_errors = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_backup_gigabytes = 1000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_backups = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_gigabytes = 1000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_groups = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_snapshots = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] quota_volumes = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] rate_limit_burst = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] rate_limit_except_level = CRITICAL {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] rate_limit_interval = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] reinit_driver_count = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] replication_device = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] report_discard_supported = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] report_interval = 120 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] reservation_clean_interval = 86400 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] reservation_expire = 86400 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] reserved_image_namespaces = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] reserved_percentage = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] rpc_response_timeout = 120 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] run_external_periodic_tasks = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] scst_target_driver = iscsi {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] scst_target_iqn_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_down_time = 720 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] shell_completion = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] snapshot_name_template = snapshot-%s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] snapshot_same_host = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] split_loggers = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] state_path = /opt/stack/data/cinder {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] storage_availability_zone = nova {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] storage_protocol = iSCSI {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] syslog_log_facility = LOG_USER {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_helper = lioadm {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_ip_address = 192.168.122.154 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_port = 3260 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_protocol = iscsi {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] target_secondary_ip_addresses = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] trace_flags = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] transport_url = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] until_refresh = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_chap_auth = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_default_quota_class = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_journal = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_json = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_multipath_for_image_xfer = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_stderr = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] use_syslog = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] verify_glance_signatures = enabled {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_api_class = cinder.volume.api.API {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_backend_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_clear = zero {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_clear_ionice = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_clear_size = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_copy_bps_limit = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_dd_blocksize = 1M {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_name_template = volume-%s {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_service_inithost_offload = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volume_usage_audit_period = month {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] zoning_mode = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_concurrency.disable_process_locking = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.auth_section = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.auth_type = password {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.auth_version = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.cache = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.include_service_catalog = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.interface = public {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_password = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcache_username = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.region_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.service_type = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.backend = dogpile.cache.null {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.backend_argument = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.backend_expiration_time = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.config_prefix = cache.oslo {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.debug_cache_backend = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.enable_retry_client = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.enable_socket_keepalive = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.expiration_time = 600 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.hashclient_retry_attempts = 2 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_dead_retry = 300 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_pool_maxsize = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_sasl_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.password = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.proxies = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.redis_db = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.redis_server = localhost:6379 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.retry_attempts = 2 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.retry_delay = 0.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.socket_keepalive_count = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.socket_keepalive_idle = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.socket_keepalive_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.socket_timeout = 1.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.tls_allowed_ciphers = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.tls_cafile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.tls_certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.tls_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.tls_keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cache.username = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] coordination.backend_url = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.asyncio_connection = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.asyncio_slave_connection = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.backend = sqlalchemy {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.connection = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.connection_debug = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.connection_parameters = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.connection_recycle_time = 3600 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.connection_trace = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.db_inc_retry_interval = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.db_max_retries = 20 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.db_max_retry_interval = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.db_retry_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.max_overflow = 50 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.max_pool_size = 5 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.max_retries = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.mysql_wsrep_sync_wait = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.pool_timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.retry_interval = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.slave_connection = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.sqlite_synchronous = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.synchronous_reader = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] database.use_db_reconnect = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.connection_string = messaging:// {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.es_doc_type = notification {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.es_scroll_size = 10000 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.es_scroll_time = 2m {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.filter_error_trace = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.hmac_keys = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.sentinel_service_name = mymaster {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.socket_timeout = 0.1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.trace_requests = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler.trace_sqlalchemy = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler_jaeger.process_tags = {} {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler_jaeger.service_name_prefix = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] profiler_otlp.service_name_prefix = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.enforce_new_defaults = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.policy_default_rule = default {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.087s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.policy_file = policy.yaml {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.group = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.helper_command = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] privsep_osbrick.user = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.group = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.helper_command = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] cinder_sys_admin.user = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.auth_section = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack sudo[77784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 05 15:40:48 devstack sudo[77784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.auth_type = password {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.cafile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.collect_timing = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.send_service_user_token = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.split_loggers = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] service_user.timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.auth_section = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.auth_type = password {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.collect_timing = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.region_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.split_loggers = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] glance.timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.backend_availability_zone = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.chap_password = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.chap_username = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.disk_geometry = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_client_cert = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_client_cert_key = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_data_namespace = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.driver_use_ssl = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.extra_capabilities = {} {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.filter_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.goodness_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iscsi_target_flags = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iscsi_write_cache = on {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iser_helper = tgtadm {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iser_port = 3260 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.lvm_mirrors = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.lvm_share_target = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.lvm_type = auto {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.num_shell_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.replication_device = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.report_discard_supported = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.reserved_percentage = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_helper = tgtadm {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_port = 3260 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_protocol = iscsi {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.trace_flags = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.unique_fqdn_network = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.use_chap_auth = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_backend_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_clear = zero {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_clear_ionice = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_clear_size = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volume_group = cinder-volumes {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_reports.file_event_handler = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_reports.log_dir = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.backend_host = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.chap_password = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.chap_username = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.chiscsi_conf = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.disk_geometry = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_client_cert = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.driver_use_ssl = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.extra_capabilities = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.filter_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.goodness_function = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iser_helper = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iser_ip_address = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iser_port = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.lvm_conf_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.lvm_mirrors = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.lvm_share_target = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.lvm_type = auto {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.num_shell_tries = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.nvmet_port_id = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.replication_device = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.report_discard_supported = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.reserved_percentage = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.scst_target_driver = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.storage_protocol = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_helper = lioadm {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_ip_address = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_port = 3260 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_protocol = iscsi {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.trace_flags = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.use_chap_auth = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_clear = zero {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_clear_size = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] lvmdriver-1.volumes_dir = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_notifications.driver = [] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_notifications.retry = -1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] key_manager.fixed_key = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.barbican_api_version = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.barbican_endpoint = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.barbican_endpoint_type = public {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.barbican_region_name = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.cafile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.collect_timing = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.number_of_retries = 60 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.retry_delay = 1 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.send_service_user_token = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.split_loggers = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.verify_ssl = True {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican.verify_ssl_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.auth_section = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.auth_type = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.cafile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.certfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.collect_timing = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.insecure = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.keyfile = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.split_loggers = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] barbican_service_user.timeout = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.approle_role_id = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.approle_secret_id = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.auth_method = approle {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.auth_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.kv_mountpoint = secret {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.kv_path = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.kv_version = 2 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.namespace = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.root_token_id = **** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.ssl_ca_crt_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.timeout = 60.0 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.token_file = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.token_role = None {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.use_ssl = False {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:40:48 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] ******************************************************************************** {{(pid=77622) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:40:48 devstack sudo[77784]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.408s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:48 devstack sudo[77847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:48 devstack sudo[77847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:48 devstack sudo[77847]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.359s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:40:48 devstack cinder-volume[77779]: INFO cinder.brick.local_dev.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 05 15:40:48 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:49 devstack sudo[77993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:49 devstack sudo[77993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:49 devstack sudo[77993]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG cinder.brick.local_dev.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77779) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:49 devstack sudo[78095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:49 devstack sudo[78095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:49 devstack sudo[78095]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.517s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:49 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:49 devstack sudo[78289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:49 devstack sudo[78289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[78289]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack sudo[78395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 05 15:40:50 devstack sudo[78395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[78395]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack sudo[78398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:50 devstack sudo[78398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[78398]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack sudo[78482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:50 devstack sudo[78482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[78482]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack sudo[78485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:51 devstack sudo[78485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:51 devstack sudo[78485]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack sudo[78514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:51 devstack sudo[78514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:51 devstack sudo[78514]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack sudo[78578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:51 devstack sudo[78578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:51 devstack sudo[78578]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:51 devstack cinder-volume[77779]: INFO cinder.volume.drivers.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:51 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:51 devstack sudo[78582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:51 devstack sudo[78582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack sudo[78582]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[78585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:52 devstack sudo[78585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack sudo[78585]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[78589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:52 devstack sudo[78589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack sudo[78589]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[78598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:52 devstack sudo[78598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack sudo[78598]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:52 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[78601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:52 devstack sudo[78601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:53 devstack sudo[78601]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[77779]: INFO cinder.volume.driver [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG cinder.volume.driver [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77779) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_db.sqlalchemy.engines [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG dbcounter [-] [77779] Writer thread running {{(pid=77779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG cinder.db.api [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Building query based on filter {{(pid=77779) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG cinder.image.image_utils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77779) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:40:53 devstack cinder-volume[77779]: INFO cinder.keymgr.migration [None req-3b1a57a5-ca7b-4936-b053-c0c5531b9e48 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[78605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:53 devstack sudo[78605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:53 devstack sudo[78605]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[78609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:53 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:53 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[78613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:53 devstack sudo[78613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack sudo[78613]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:54 devstack sudo[78617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:54 devstack sudo[78617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack sudo[78617]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG cinder.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Notifying Schedulers of capabilities ... {{(pid=77779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:54 devstack cinder-volume[77779]: INFO cinder.volume.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Driver initialization completed successfully. Aug 05 15:40:54 devstack cinder-volume[77779]: INFO cinder.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Initiating service 2 cleanup Aug 05 15:40:54 devstack cinder-volume[77779]: INFO cinder.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Service 2 cleanup completed. Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG cinder.service [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Creating RPC server for service cinder-volume {{(pid=77779) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG cinder.service [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77779) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:40:54 devstack cinder-volume[77779]: INFO cinder.volume.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:54 devstack sudo[78622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:40:54 devstack sudo[78622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack sudo[78622]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:54 devstack sudo[78625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:54 devstack sudo[78625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:55 devstack sudo[78625]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:55 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:55 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:55 devstack sudo[78628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:40:55 devstack sudo[78628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:55 devstack sudo[78628]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:55 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:55 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:55 devstack sudo[78631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:40:55 devstack sudo[78631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:55 devstack sudo[78631]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:55 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:55 devstack cinder-volume[77779]: INFO cinder.volume.manager [None req-25f402f6-8ac1-47cc-ac2d-f70a90c77633 None None] Driver post RPC initialization completed successfully. Aug 05 15:40:57 devstack cinder-volume[77622]: DEBUG dbcounter [-] [77622] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:40:58 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager._thread_info {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:40:58 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread count: 6 {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:40:58 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread info: [<_MainThread(MainThread, started 132862068273280)>, , , , , ] {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:41:05 devstack cinder-volume[77779]: DEBUG dbcounter [-] [77779] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:41:05 devstack cinder-volume[77779]: DEBUG dbcounter [-] [77779] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:41:58 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:41:58 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:41:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:58 devstack sudo[80658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:41:58 devstack sudo[80658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:58 devstack sudo[80658]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:59 devstack sudo[80661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:41:59 devstack sudo[80661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:59 devstack sudo[80661]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:59 devstack sudo[80664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:41:59 devstack sudo[80664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:59 devstack sudo[80664]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:59 devstack sudo[80667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:41:59 devstack sudo[80667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:59 devstack sudo[80667]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG cinder.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Notifying Schedulers of capabilities ... {{(pid=77779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager._thread_info {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread count: 6 {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:41:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread info: [<_MainThread(MainThread, started 132862068273280)>, , , , , ] {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:42:58 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:42:58 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:42:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:58 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:42:58 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:58 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:59 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:42:59 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:59 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:59 devstack sudo[84044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:42:59 devstack sudo[84044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:59 devstack sudo[84044]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:59 devstack sudo[84047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:42:59 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:59 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:59 devstack cinder-volume[77779]: DEBUG cinder.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Notifying Schedulers of capabilities ... {{(pid=77779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:05 devstack cinder-volume[77779]: DEBUG dbcounter [-] [77779] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:43:58 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:43:58 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:43:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:58 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:43:58 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:43:59 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:43:59 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:43:59 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG cinder.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Notifying Schedulers of capabilities ... {{(pid=77779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager._thread_info {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread count: 6 {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:43:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread info: [<_MainThread(MainThread, started 132862068273280)>, , , , , ] {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:44:58 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:44:58 devstack cinder-volume[77779]: DEBUG cinder.volume.drivers.lvm [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Updating volume stats {{(pid=77779) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:44:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:58 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:44:58 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:58 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:58 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:59 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:44:59 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:59 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:59 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:44:59 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:59 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:59 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:44:59 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:59 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_concurrency.processutils [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77779) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG cinder.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Notifying Schedulers of capabilities ... {{(pid=77779) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG oslo_service.periodic_task [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] Running periodic task VolumeManager._thread_info {{(pid=77779) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread count: 6 {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:44:59 devstack cinder-volume[77779]: DEBUG cinder.volume.manager [None req-e0ac8231-870c-46e9-a8c0-9ea07790e5fa None None] thread info: [<_MainThread(MainThread, started 132862068273280)>, , , , , ] {{(pid=77779) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:45:05 devstack cinder-volume[77779]: DEBUG dbcounter [-] [77779] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:45:18 devstack cinder-volume[77622]: INFO oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Caught SIGTERM, stopping children Aug 05 15:45:18 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Acquiring lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:18 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Acquired lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:18 devstack cinder-volume[77622]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Releasing lock "singleton_lock" {{(pid=77622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:18 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Stop services. {{(pid=77622) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 15:45:18 devstack cinder-volume[77622]: DEBUG oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Killing children. {{(pid=77622) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 15:45:18 devstack cinder-volume[77622]: INFO oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Waiting on 1 children to exit Aug 05 15:45:19 devstack cinder-volume[77779]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Acquiring lock "singleton_lock" {{(pid=77779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:19 devstack cinder-volume[77779]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Acquired lock "singleton_lock" {{(pid=77779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:19 devstack cinder-volume[77779]: DEBUG oslo_concurrency.lockutils [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Releasing lock "singleton_lock" {{(pid=77779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:19 devstack cinder-volume[77779]: WARNING amqp [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:45:19 devstack cinder-volume[77779]: WARNING amqp [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:45:19 devstack cinder-volume[77622]: INFO oslo_service.backend._eventlet.service [None req-44f05cd5-e7b7-4689-a4be-0d4ea9dd57fd None None] Child 77779 exited with status 0 Aug 05 15:45:20 devstack cinder-volume[87882]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:45:20 devstack cinder-volume[87882]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:45:20 devstack cinder-volume[87882]: we strongly recommend against using it for new projects. Aug 05 15:45:20 devstack cinder-volume[87882]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:45:20 devstack cinder-volume[87882]: framework. For more detail see Aug 05 15:45:20 devstack cinder-volume[87882]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:45:20 devstack cinder-volume[87882]: import eventlet # noqa Aug 05 15:45:22 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:22 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:22 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:22 devstack cinder-volume[87882]: INFO dbcounter [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Registered counter for database cinder Aug 05 15:45:22 devstack cinder-volume[87882]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG dbcounter [-] [87882] Writer thread running {{(pid=87882) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:45:23 devstack cinder-volume[87882]: INFO cinder.rpc [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:45:23 devstack cinder-volume[87882]: INFO cinder.rpc [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:23 devstack cinder-volume[87882]: INFO cinder.volume.manager [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Determined volume DB was empty at startup. Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG cinder.volume.manager [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87882) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:45:23 devstack cinder-volume[87882]: INFO cinder.volume.manager [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 15:45:23 devstack cinder-volume[87882]: WARNING stevedore.named [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:45:23 devstack cinder-volume[87882]: WARNING castellan.key_manager [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:45:23 devstack cinder-volume[87882]: WARNING cinder.keymgr.conf_key_mgr [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:45:23 devstack cinder-volume[87882]: INFO cinder.volume.manager [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87882) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:23 devstack cinder-volume[87882]: INFO oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Starting 1 workers Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Started child 88133 {{(pid=87882) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Full set of CONF: {{(pid=87882) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] ******************************************************************************** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Configuration options gathered from: {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] ================================================================================ {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] allow_availability_zone_fallback = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] allow_compression_on_image_upload = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] allowed_direct_url_schemes = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] api_rate_limit = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] auth_strategy = keystone {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_availability_zone = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_host = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[88133]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_stats_polling_interval = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backup_api_class = cinder.backup.api.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backup_name_template = backup-%s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backup_use_same_host = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backup_use_temp_snapshot = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] chap_password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] chap_username = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_internal_tenant_project_id = 371f8ab0e6c84e81987027c987d113d9 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_internal_tenant_user_id = e39b2ca7d5c4433d97c02e48c2105e65 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cluster = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] compression_format = gzip {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] config_dir = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] config_source = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] control_exchange = openstack {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] debug = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] default_availability_zone = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] default_group_type = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] default_volume_type = QuobyteHD {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] disk_geometry = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_client_cert = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_client_cert_key = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_data_namespace = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_ssl_cert_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_ssl_cert_verify = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] driver_use_ssl = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] enable_new_services = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] enable_unsupported_driver = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] enforce_multipath_for_image_xfer = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] filter_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_api_insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_api_ssl_compression = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_ca_certificates_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_num_retries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance_request_timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] goodness_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] graceful_shutdown_timeout = 5 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] group_api_class = cinder.group.api.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] host = devstack {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_compress_on_upload = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_conversion_address_space_limit = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_conversion_cpu_limit = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_conversion_disable = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_upload_use_cinder_backend = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_upload_use_internal_tenant = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_volume_cache_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_volume_cache_max_count = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] init_host_max_objects_retrieval = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] instance_format = [instance: %(uuid)s] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iscsi_target_flags = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iscsi_write_cache = on {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iser_helper = tgtadm {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iser_ip_address = 192.168.122.154 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iser_port = 3260 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_color = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_config_append = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_dir = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_options = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_rotate_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_rotate_interval_type = days {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] log_rotation_type = none {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] max_age = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] max_logfile_count = 30 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] max_logfile_size_mb = 200 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] max_over_subscription_ratio = 20.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] message_reap_interval = 86400 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] message_ttl = 2592000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] monkey_patch = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] monkey_patch_modules = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] my_ip = 192.168.122.154 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] no_snapshot_gb_quota = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] num_iser_scan_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[88133]: INFO cinder.volume.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Starting volume driver QuobyteDriver (1.1.14) Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.remotefs [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88133) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] num_shell_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] num_volume_device_scan_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] nvmeof_conn_info_version = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] nvmet_ns_id = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] nvmet_port_id = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_max_limit = 1000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_ext_list = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_listen_port = 8776 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_use_ssl = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] osapi_volume_workers = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] per_volume_size_limit = -1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] periodic_fuzzy_delay = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] periodic_interval = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] public_endpoint = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] publish_errors = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_backup_gigabytes = 1000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_backups = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_gigabytes = 1000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_groups = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_snapshots = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] quota_volumes = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] rate_limit_burst = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] rate_limit_except_level = CRITICAL {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] rate_limit_interval = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] reinit_driver_count = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] replication_device = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] report_discard_supported = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] report_interval = 120 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] reservation_clean_interval = 86400 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] reservation_expire = 86400 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] reserved_image_namespaces = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] reserved_percentage = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] rpc_response_timeout = 120 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] run_external_periodic_tasks = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] scst_target_driver = iscsi {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] scst_target_iqn_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_down_time = 720 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] shell_completion = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] snapshot_name_template = snapshot-%s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] split_loggers = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] state_path = /opt/stack/data/cinder {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] storage_availability_zone = nova {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] storage_protocol = iSCSI {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] syslog_log_facility = LOG_USER {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_helper = lioadm {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_ip_address = 192.168.122.154 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_port = 3260 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_protocol = iscsi {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] target_secondary_ip_addresses = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] trace_flags = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] transport_url = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] until_refresh = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_chap_auth = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_default_quota_class = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_journal = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_json = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_multipath_for_image_xfer = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_stderr = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] use_syslog = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] verify_glance_signatures = enabled {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_api_class = cinder.volume.api.API {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_backend_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_clear = zero {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_clear_ionice = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_clear_size = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_copy_bps_limit = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_dd_blocksize = 1M {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_name_template = volume-%s {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_service_inithost_offload = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volume_usage_audit_period = month {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] zoning_mode = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.auth_section = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.auth_type = password {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.auth_version = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.cache = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.interface = public {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_password = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcache_username = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.region_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.service_type = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.backend = dogpile.cache.null {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.backend_argument = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.backend_expiration_time = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.config_prefix = cache.oslo {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.debug_cache_backend = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.enable_retry_client = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.enable_socket_keepalive = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.expiration_time = 600 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_dead_retry = 300 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_sasl_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.proxies = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.redis_db = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.redis_server = localhost:6379 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.retry_attempts = 2 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.retry_delay = 0.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.socket_keepalive_count = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.socket_keepalive_idle = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.socket_keepalive_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.socket_timeout = 1.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.tls_allowed_ciphers = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.tls_cafile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.tls_certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.tls_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.tls_keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cache.username = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] coordination.backend_url = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.asyncio_connection = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.asyncio_slave_connection = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.backend = sqlalchemy {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.connection = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.connection_debug = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.connection_parameters = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.connection_recycle_time = 3600 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.connection_trace = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.db_inc_retry_interval = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.db_max_retries = 20 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.db_max_retry_interval = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.db_retry_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.max_overflow = 50 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.max_pool_size = 5 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.max_retries = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.pool_timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.retry_interval = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.slave_connection = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.sqlite_synchronous = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.synchronous_reader = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] database.use_db_reconnect = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.connection_string = messaging:// {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.es_doc_type = notification {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.es_scroll_size = 10000 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.es_scroll_time = 2m {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.filter_error_trace = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.hmac_keys = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.sentinel_service_name = mymaster {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.socket_timeout = 0.1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.trace_requests = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler.trace_sqlalchemy = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler_jaeger.process_tags = {} {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] profiler_otlp.service_name_prefix = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.policy_default_rule = default {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.group = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.helper_command = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] privsep_osbrick.user = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.group = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.helper_command = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] cinder_sys_admin.user = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.auth_section = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.auth_type = password {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.cafile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.collect_timing = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.send_service_user_token = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.split_loggers = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] service_user.timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.auth_section = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.auth_type = password {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.collect_timing = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.region_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.split_loggers = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] glance.timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.backend_availability_zone = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.chap_password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.chap_username = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.disk_geometry = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_client_cert = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_data_namespace = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.driver_use_ssl = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.extra_capabilities = {} {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.filter_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.goodness_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88133) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iscsi_target_flags = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iser_port = 3260 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[88133]: WARNING cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 15:45:23 devstack cinder-volume[88133]: WARNING cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_host = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_login = admin {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_mount_options = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Running cmd (subprocess): mount.quobyte {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_private_key = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_share_path = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.replication_device = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.report_discard_supported = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_helper = tgtadm {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_port = 3260 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_protocol = iscsi {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.trace_flags = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.use_chap_auth = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_backend_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_clear = zero {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_reports.file_event_handler = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_reports.log_dir = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.backend_host = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.chap_password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.chap_username = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.disk_geometry = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_client_cert = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.extra_capabilities = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.filter_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.goodness_function = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iser_helper = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iser_ip_address = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iser_port = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_host = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_login = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_mount_options = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_password = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_private_key = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_share_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.num_shell_tries = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.replication_device = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.report_discard_supported = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.reserved_percentage = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.scst_target_driver = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.storage_protocol = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_helper = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_ip_address = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_port = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_prefix = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_protocol = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.trace_flags = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.use_chap_auth = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_clear = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_clear_size = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] QuobyteHD.volumes_dir = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_notifications.driver = [] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] key_manager.fixed_key = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.barbican_api_version = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.barbican_endpoint = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.barbican_endpoint_type = public {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.barbican_region_name = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.cafile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.collect_timing = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.number_of_retries = 60 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.retry_delay = 1 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.send_service_user_token = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.split_loggers = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.verify_ssl = True {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican.verify_ssl_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.auth_section = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.auth_type = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.cafile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.certfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.collect_timing = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.insecure = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.keyfile = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.split_loggers = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] barbican_service_user.timeout = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.approle_role_id = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.approle_secret_id = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.auth_method = approle {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.auth_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.kv_mountpoint = secret {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.kv_path = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.kv_version = 2 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.namespace = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.root_token_id = **** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.ssl_ca_crt_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.timeout = 60.0 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.token_file = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.token_role = None {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.use_ssl = False {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:23 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] ******************************************************************************** {{(pid=87882) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:45:23 devstack quobyte-client[88136]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 15:45:23 devstack quobyte-client[88136]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:23 devstack cinder-volume[88133]: INFO cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 ... Aug 05 15:45:23 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 -c /etc/quobyte/client-cinder.cfg {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:23 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 -c /etc/quobyte/client-cinder.cfg Aug 05 15:45:23 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:24 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 succeeded Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:24 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:24 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:24 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.239s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.volume.driver [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.volume.driver [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6386604309082, 'free_capacity_gb': 1775.6386604309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88133) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88133) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG dbcounter [-] [88133] Writer thread running {{(pid=88133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.db.api [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Building query based on filter {{(pid=88133) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.image.image_utils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88133) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.keymgr.migration [None req-23b9aca6-2ffa-4617-bdbf-f1c8a37be968 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:24 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:24 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:24 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.234s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Notifying Schedulers of capabilities ... {{(pid=88133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.volume.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Driver initialization completed successfully. Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Initiating service 3 cleanup Aug 05 15:45:24 devstack cinder-volume[88133]: INFO cinder.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Service 3 cleanup completed. Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.service [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Creating RPC server for service cinder-volume {{(pid=88133) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:45:24 devstack cinder-volume[88133]: DEBUG cinder.service [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88133) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:45:25 devstack cinder-volume[88133]: INFO cinder.volume.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:25 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:25 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:25 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:25 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.271s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:25 devstack cinder-volume[88133]: INFO cinder.volume.manager [None req-e2f739ca-ab3d-436f-b784-8082715bca00 None None] Driver post RPC initialization completed successfully. Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG cinder.volume.drivers.quobyte [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88133) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:29 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:29 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88133]: DEBUG oslo_concurrency.processutils [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.247s {{(pid=88133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88133]: DEBUG cinder.manager [None req-ef124a89-b90a-4d80-804b-db8e4e39bac9 None None] Notifying Schedulers of capabilities ... {{(pid=88133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:30 devstack cinder-volume[87882]: INFO oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Caught SIGTERM, stopping children Aug 05 15:45:30 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Acquiring lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:30 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Acquired lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:30 devstack cinder-volume[87882]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Releasing lock "singleton_lock" {{(pid=87882) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:30 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Stop services. {{(pid=87882) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 15:45:30 devstack cinder-volume[87882]: DEBUG oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Killing children. {{(pid=87882) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 15:45:30 devstack cinder-volume[87882]: INFO oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Waiting on 1 children to exit Aug 05 15:45:33 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Acquiring lock "singleton_lock" {{(pid=88133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:33 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Acquired lock "singleton_lock" {{(pid=88133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:33 devstack cinder-volume[88133]: DEBUG oslo_concurrency.lockutils [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Releasing lock "singleton_lock" {{(pid=88133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:33 devstack cinder-volume[88133]: WARNING amqp [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:45:33 devstack cinder-volume[88133]: WARNING amqp [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:45:33 devstack cinder-volume[87882]: INFO oslo_service.backend._eventlet.service [None req-e3fe2985-36aa-43b9-ab9b-5837a4f978f7 None None] Child 88133 exited with status 0 Aug 05 15:45:33 devstack cinder-volume[88419]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:45:33 devstack cinder-volume[88419]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:45:33 devstack cinder-volume[88419]: we strongly recommend against using it for new projects. Aug 05 15:45:33 devstack cinder-volume[88419]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:45:33 devstack cinder-volume[88419]: framework. For more detail see Aug 05 15:45:33 devstack cinder-volume[88419]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:45:33 devstack cinder-volume[88419]: import eventlet # noqa Aug 05 15:45:36 devstack cinder-volume[88419]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:45:36 devstack cinder-volume[88419]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:45:36 devstack cinder-volume[88419]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88419) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:45:37 devstack cinder-volume[88419]: INFO dbcounter [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Registered counter for database cinder Aug 05 15:45:37 devstack cinder-volume[88419]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG dbcounter [-] [88419] Writer thread running {{(pid=88419) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:45:38 devstack cinder-volume[88419]: INFO cinder.rpc [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:45:38 devstack cinder-volume[88419]: INFO cinder.rpc [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:38 devstack cinder-volume[88419]: INFO cinder.volume.manager [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Determined volume DB was empty at startup. Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG cinder.volume.manager [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88419) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:45:38 devstack cinder-volume[88419]: WARNING stevedore.named [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:45:38 devstack cinder-volume[88419]: WARNING castellan.key_manager [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:45:38 devstack cinder-volume[88419]: WARNING cinder.keymgr.conf_key_mgr [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:45:38 devstack cinder-volume[88419]: INFO cinder.volume.manager [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88419) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:38 devstack cinder-volume[88419]: INFO oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Starting 1 workers Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Started child 88715 {{(pid=88419) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Full set of CONF: {{(pid=88419) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] ******************************************************************************** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] Configuration options gathered from: {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] ================================================================================ {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] allow_availability_zone_fallback = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] allow_compression_on_image_upload = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88715]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] allowed_direct_url_schemes = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] api_rate_limit = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] auth_strategy = keystone {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_availability_zone = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_host = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_stats_polling_interval = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backup_api_class = cinder.backup.api.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backup_name_template = backup-%s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backup_use_same_host = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backup_use_temp_snapshot = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] chap_password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] chap_username = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_internal_tenant_project_id = 371f8ab0e6c84e81987027c987d113d9 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_internal_tenant_user_id = e39b2ca7d5c4433d97c02e48c2105e65 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cluster = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] compression_format = gzip {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] compute_api_class = cinder.compute.nova.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] config_dir = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] config_source = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] control_exchange = openstack {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] debug = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] default_availability_zone = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] default_group_type = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] default_volume_type = QuobyteHD {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] disk_geometry = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_client_cert = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_client_cert_key = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_data_namespace = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_ssl_cert_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_ssl_cert_verify = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] driver_use_ssl = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] enable_new_services = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] enable_unsupported_driver = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] enabled_backends = ['QuobyteHD'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] enforce_multipath_for_image_xfer = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] filter_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_api_insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_api_ssl_compression = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_ca_certificates_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_catalog_info = image:glance:publicURL {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_num_retries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance_request_timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] goodness_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] graceful_shutdown_timeout = 5 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] group_api_class = cinder.group.api.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] host = devstack {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_compress_on_upload = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_conversion_address_space_limit = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_conversion_cpu_limit = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_conversion_disable = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_upload_use_cinder_backend = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_upload_use_internal_tenant = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_volume_cache_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_volume_cache_max_count = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] image_volume_cache_max_size_gb = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] init_host_max_objects_retrieval = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] instance_format = [instance: %(uuid)s] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iscsi_target_flags = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iscsi_write_cache = on {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iser_helper = tgtadm {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iser_ip_address = 192.168.122.154 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iser_port = 3260 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_color = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_config_append = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_dir = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_options = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_rotate_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_rotate_interval_type = days {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] log_rotation_type = none {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] max_age = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] max_logfile_count = 30 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] max_logfile_size_mb = 200 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] max_over_subscription_ratio = 20.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] message_reap_interval = 86400 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] message_ttl = 2592000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] migration_create_volume_timeout_secs = 300 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] monkey_patch = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] monkey_patch_modules = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] my_ip = 192.168.122.154 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] no_snapshot_gb_quota = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] num_iser_scan_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] num_shell_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] num_volume_device_scan_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] nvmeof_conn_info_version = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] nvmet_ns_id = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] nvmet_port_id = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_max_limit = 1000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_ext_list = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_listen_port = 8776 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_use_ssl = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] osapi_volume_workers = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] per_volume_size_limit = -1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] periodic_fuzzy_delay = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] periodic_interval = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] public_endpoint = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] publish_errors = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_backup_gigabytes = 1000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_backups = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_gigabytes = 1000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_groups = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_snapshots = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] quota_volumes = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] rate_limit_burst = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] rate_limit_except_level = CRITICAL {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] rate_limit_interval = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] reinit_driver_count = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] replication_device = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] report_discard_supported = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] report_interval = 120 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] reservation_clean_interval = 86400 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] reservation_expire = 86400 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] reserved_image_namespaces = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] reserved_percentage = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Starting volume driver QuobyteDriver (1.1.14) Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88715) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] rpc_response_timeout = 120 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] run_external_periodic_tasks = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] scst_target_driver = iscsi {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] scst_target_iqn_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_down_time = 720 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] shell_completion = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] snapshot_name_template = snapshot-%s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] split_loggers = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] state_path = /opt/stack/data/cinder {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] storage_availability_zone = nova {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] storage_protocol = iSCSI {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] syslog_log_facility = LOG_USER {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_helper = lioadm {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_ip_address = 192.168.122.154 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_port = 3260 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_protocol = iscsi {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] target_secondary_ip_addresses = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] trace_flags = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] transport_url = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] until_refresh = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_chap_auth = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_default_quota_class = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_journal = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_json = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_multipath_for_image_xfer = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_stderr = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] use_syslog = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] verify_glance_signatures = enabled {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_api_class = cinder.volume.api.API {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_backend_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_clear = zero {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_clear_ionice = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_clear_size = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_copy_bps_limit = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_dd_blocksize = 1M {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_name_template = volume-%s {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_service_inithost_offload = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volume_usage_audit_period = month {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] zoning_mode = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_concurrency.disable_process_locking = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.auth_section = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.auth_type = password {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.auth_version = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.cache = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.include_service_catalog = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.interface = public {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_password = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcache_username = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.region_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.service_type = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.backend = dogpile.cache.null {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.backend_argument = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.backend_expiration_time = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.config_prefix = cache.oslo {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.debug_cache_backend = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.enable_retry_client = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.enable_socket_keepalive = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.expiration_time = 600 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.hashclient_retry_attempts = 2 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_dead_retry = 300 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_pool_maxsize = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_sasl_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.proxies = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.redis_db = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.redis_server = localhost:6379 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.retry_attempts = 2 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.retry_delay = 0.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.socket_keepalive_count = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.socket_keepalive_idle = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.socket_keepalive_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.socket_timeout = 1.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.tls_allowed_ciphers = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.tls_cafile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.tls_certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.tls_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.tls_keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cache.username = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] coordination.backend_url = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.asyncio_connection = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.asyncio_slave_connection = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.backend = sqlalchemy {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.connection = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.connection_debug = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.connection_parameters = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.connection_recycle_time = 3600 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.connection_trace = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.db_inc_retry_interval = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.db_max_retries = 20 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.db_max_retry_interval = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.db_retry_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.max_overflow = 50 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.max_pool_size = 5 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.max_retries = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.mysql_wsrep_sync_wait = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.pool_timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.retry_interval = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.slave_connection = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.sqlite_synchronous = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.synchronous_reader = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] database.use_db_reconnect = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.connection_string = messaging:// {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.es_doc_type = notification {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.es_scroll_size = 10000 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.es_scroll_time = 2m {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.filter_error_trace = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.hmac_keys = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.sentinel_service_name = mymaster {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.socket_timeout = 0.1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.trace_requests = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler.trace_sqlalchemy = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler_jaeger.process_tags = {} {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler_jaeger.service_name_prefix = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] profiler_otlp.service_name_prefix = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.enforce_new_defaults = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.policy_default_rule = default {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.policy_file = policy.yaml {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.group = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.helper_command = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] privsep_osbrick.user = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.group = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.helper_command = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] cinder_sys_admin.user = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.auth_section = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.auth_type = password {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.cafile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.collect_timing = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.send_service_user_token = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.split_loggers = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] service_user.timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.auth_section = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.auth_type = password {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.collect_timing = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.region_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.split_loggers = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] glance.timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.backend_availability_zone = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.chap_password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.chap_username = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.disk_geometry = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_client_cert = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_client_cert_key = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_data_namespace = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.driver_use_ssl = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.extra_capabilities = {} {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.filter_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.goodness_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iscsi_target_flags = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iscsi_write_cache = on {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iser_helper = tgtadm {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iser_port = 3260 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_host = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_login = admin {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_mount_options = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_private_key = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_share_path = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.num_shell_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.quobyte_volume_url = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.replication_device = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.report_discard_supported = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.reserved_percentage = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_helper = tgtadm {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_port = 3260 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_protocol = iscsi {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.trace_flags = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.unique_fqdn_network = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.use_chap_auth = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_backend_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_clear = zero {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_clear_ionice = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_clear_size = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88715) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Aug 05 15:45:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 15:45:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Running cmd (subprocess): mount.quobyte {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_reports.file_event_handler = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_reports.log_dir = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.backend_availability_zone = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.backend_host = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.chap_password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.chap_username = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.chiscsi_conf = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.disk_geometry = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_client_cert = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_data_namespace = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.driver_use_ssl = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.extra_capabilities = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.filter_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.goodness_function = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iser_helper = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iser_ip_address = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iser_port = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.iser_target_prefix = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_host = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_login = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_mount_options = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_password = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_private_key = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_share_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_ssh_port = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.num_shell_tries = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.nvmet_port_id = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.replication_device = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.report_discard_supported = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.reserved_percentage = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.scst_target_driver = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.storage_protocol = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_helper = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_ip_address = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_port = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_prefix = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_protocol = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.trace_flags = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.use_chap_auth = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_clear = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_clear_size = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] QuobyteHD.volumes_dir = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_notifications.driver = [] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_notifications.retry = -1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] key_manager.fixed_key = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.barbican_api_version = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.barbican_endpoint = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.barbican_endpoint_type = public {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.barbican_region_name = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.cafile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.collect_timing = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.number_of_retries = 60 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.retry_delay = 1 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.send_service_user_token = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.split_loggers = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.verify_ssl = True {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican.verify_ssl_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.auth_section = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.auth_type = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.cafile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.certfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.collect_timing = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.insecure = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.keyfile = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.split_loggers = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] barbican_service_user.timeout = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.approle_role_id = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.approle_secret_id = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.auth_method = approle {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.auth_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.kv_mountpoint = secret {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.kv_path = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.kv_version = 2 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.namespace = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.root_token_id = **** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.ssl_ca_crt_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.timeout = 60.0 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.token_file = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.token_role = None {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.use_ssl = False {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:45:38 devstack cinder-volume[88419]: DEBUG oslo_service.backend._eventlet.service [None req-bbb4f9bc-bb32-4573-b0c6-8da0fe7c0360 None None] ******************************************************************************** {{(pid=88419) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:45:38 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:38 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:38 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.248s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:38 devstack cinder-volume[88715]: INFO cinder.volume.driver [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.volume.driver [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6386604309082, 'free_capacity_gb': 1775.6386604309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88715) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG oslo_db.sqlalchemy.engines [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88715) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writer thread running {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:45:38 devstack cinder-volume[88715]: DEBUG cinder.db.api [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Building query based on filter {{(pid=88715) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88715) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.keymgr.migration [None req-21d7c769-de33-4724-8390-9a8f048227a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:45:39 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:39 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:39 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.255s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Driver initialization completed successfully. Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Initiating service 3 cleanup Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Service 3 cleanup completed. Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.service [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Creating RPC server for service cinder-volume {{(pid=88715) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.service [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88715) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:39 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:45:39 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:39 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.228s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e66d165c-9a51-44ce-8640-a5626a2cb6e1 None None] Driver post RPC initialization completed successfully. Aug 05 15:45:48 devstack cinder-volume[88419]: DEBUG dbcounter [-] [88419] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88419) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:45:49 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:45:49 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:46:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:46:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 6 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:46:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Flow 'volume_create_manager' (89b477a9-adae-4c25-b271-18ddd0a6d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09193f7c-f90d-48ab-a73f-5111b15482ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09193f7c-f90d-48ab-a73f-5111b15482ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1767746340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1367c6c1-a322-4806-8b3b-a5fba834d710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dccbef974414e38964c723d04ebace3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:55Z,use_quota=True,user_id='ac2178f789ab4d63bff63a8d604bb085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3145ef0-8eea-4f7f-89c8-b2bdffdb43ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3145ef0-8eea-4f7f-89c8-b2bdffdb43ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd29918-de34-4c04-b274-b26470e50335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd29918-de34-4c04-b274-b26470e50335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1367c6c1-a322-4806-8b3b-a5fba834d710', 'volume_name': 'volume-1367c6c1-a322-4806-8b3b-a5fba834d710', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a384a2e1-4aba-401f-bc55-b4b16a810175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a384a2e1-4aba-401f-bc55-b4b16a810175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1c36ef-3bb8-486d-af09-c7da3937c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:55 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Volume 1367c6c1-a322-4806-8b3b-a5fba834d710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1367c6c1-a322-4806-8b3b-a5fba834d710', 'volume_size': 1} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1767746340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1367c6c1-a322-4806-8b3b-a5fba834d710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dccbef974414e38964c723d04ebace3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:55Z,use_quota=True,user_id='ac2178f789ab4d63bff63a8d604bb085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Creating volume 1367c6c1-a322-4806-8b3b-a5fba834d710 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:46:55 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:46:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:55 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 1073741824 Aug 05 15:46:55 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:56 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 1073741824" returned: 0 in 0.984s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:56 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 Aug 05 15:46:56 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:57 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710" returned: 0 in 0.512s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1c36ef-3bb8-486d-af09-c7da3937c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1367c6c1-a322-4806-8b3b-a5fba834d710', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebd62f9-5472-48e1-a6e9-d7a8d2faf6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Volume volume-1367c6c1-a322-4806-8b3b-a5fba834d710 (1367c6c1-a322-4806-8b3b-a5fba834d710): created successfully Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebd62f9-5472-48e1-a6e9-d7a8d2faf6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Flow 'volume_create_manager' (89b477a9-adae-4c25-b271-18ddd0a6d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1550fc21-c23f-45c3-87e5-05463fd564ef tempest-DeleteServersTestJSON-1339699680 None] Created volume successfully. Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Flow 'volume_create_manager' (f72e981f-0847-42e1-ab20-27ea3139404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad4914-a56f-4ca5-a782-f59bcd494466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad4914-a56f-4ca5-a782-f59bcd494466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-786330964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088e489c-ca8c-493a-a629-0e235a7369d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360079770bfc4a5389a8bf657426e687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:00Z,use_quota=True,user_id='af1ff491372241e685bc87398c242c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65b1d86-1941-4690-9e03-f299bbd38c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65b1d86-1941-4690-9e03-f299bbd38c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe2b932-4db9-4be3-b275-705dcdd3690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe2b932-4db9-4be3-b275-705dcdd3690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '088e489c-ca8c-493a-a629-0e235a7369d2', 'volume_name': 'volume-088e489c-ca8c-493a-a629-0e235a7369d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095804f6-6253-4807-a0ee-4ebcef7012c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095804f6-6253-4807-a0ee-4ebcef7012c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d64f0e-18e0-4f9a-a493-37d776f0e32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Volume 088e489c-ca8c-493a-a629-0e235a7369d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-088e489c-ca8c-493a-a629-0e235a7369d2', 'volume_size': 1} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-786330964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=088e489c-ca8c-493a-a629-0e235a7369d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360079770bfc4a5389a8bf657426e687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:00Z,use_quota=True,user_id='af1ff491372241e685bc87398c242c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Creating volume 088e489c-ca8c-493a-a629-0e235a7369d2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:00 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:00 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 1073741824 Aug 05 15:47:00 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:02 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 1073741824" returned: 0 in 1.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:02 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 Aug 05 15:47:02 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:02 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2" returned: 0 in 0.779s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d64f0e-18e0-4f9a-a493-37d776f0e32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-088e489c-ca8c-493a-a629-0e235a7369d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9b76f0-8b5e-4449-8a71-30aa4958b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Volume volume-088e489c-ca8c-493a-a629-0e235a7369d2 (088e489c-ca8c-493a-a629-0e235a7369d2): created successfully Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9b76f0-8b5e-4449-8a71-30aa4958b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Flow 'volume_create_manager' (f72e981f-0847-42e1-ab20-27ea3139404b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e51fd309-257b-42c6-ac7d-c8d0ad36f139 tempest-VolumesAdminNegativeTest-845771777 None] Created volume successfully. Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:03 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:47:03 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:04 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:04 devstack cinder-volume[88715]: WARNING py.warnings [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 05 15:47:04 devstack cinder-volume[88715]: .first() Aug 05 15:47:04 devstack cinder-volume[88715]: Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Acquiring lock "cinder-088e489c-ca8c-493a-a629-0e235a7369d2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.667s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 6 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "cinder-088e489c-ca8c-493a-a629-0e235a7369d2-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:04 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0elaepe_/privsep.sock'] Aug 05 15:47:04 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0elaepe_/privsep.sock Aug 05 15:47:04 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Acquiring lock "cinder-quobyte-088e489c-ca8c-493a-a629-0e235a7369d2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "cinder-quobyte-088e489c-ca8c-493a-a629-0e235a7369d2" acquired by "delete_volume" :: waited 0.062s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 05 15:47:05 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:05 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Spawned new privsep daemon via rootwrap Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Accepted privsep connection to /tmp/tmp0elaepe_/privsep.sock {{(pid=88715) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 05 15:47:05 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 05 15:47:05 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 05 15:47:05 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 05 15:47:05 devstack cinder-volume[88715]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89890 Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f61d530-86f1-4631-935c-6b362afed94f]: (2,) {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:05 devstack cinder-volume[88715]: WARNING oslo_privsep.priv_context [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] privsep daemon already running Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39fd07-d9bd-4749-bb83-38ccb5d95158]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[59904a8c-27e6-4ed1-8c81-f1e4fbcbdbb4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:06 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 Aug 05 15:47:06 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:06 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 Aug 05 15:47:06 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:06 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2" returned: 0 in 0.642s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:06 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2 Aug 05 15:47:06 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:06 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710" returned: 0 in 0.947s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.380s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-1367c6c1-a322-4806-8b3b-a5fba834d710', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0006c17b-b97b-4adc-a9f5-d671b2a958b3', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:47:07 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-088e489c-ca8c-493a-a629-0e235a7369d2" returned: 0 in 0.667s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-dc1bcdea-d5de-4154-8d87-67e3a9656dbb req-a37e96f0-56c0-4673-a120-0e2a6ec00f12 tempest-DeleteServersTestJSON-1339699680 None] attachment_update completed successfully. Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "cinder-quobyte-088e489c-ca8c-493a-a629-0e235a7369d2" released by "delete_volume" :: held 2.640s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:07 devstack cinder-volume[88715]: WARNING cinder.quota [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:47:07 devstack cinder-volume[88715]: WARNING cinder.quota [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Created reservations ['10e3b0c1-7647-4ed5-8458-afe6788ddff0', '6f8a70e7-95c3-49f8-aa52-29c9db729ed0', '8f04fcd0-09ee-4bc4-a4af-e2fdb0301476', '13244fe1-e8bc-4c6e-a67c-01ed9d9610ed'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:07 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:47:07 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:08 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.663s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:08 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Deleted volume successfully. Aug 05 15:47:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-333377c1-1f1e-4370-b67b-b6db54c49e2a tempest-VolumesAdminNegativeTest-845771777 None] Lock "cinder-088e489c-ca8c-493a-a629-0e235a7369d2-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-36d57300-b92d-4afb-88cd-8d87d1d5300f req-4a4dac10-b70c-487d-8a8f-2b90f0d7ce19 tempest-DeleteServersTestJSON-1339699680 None] Terminate volume connection completed successfully. Aug 05 15:47:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-36d57300-b92d-4afb-88cd-8d87d1d5300f req-4a4dac10-b70c-487d-8a8f-2b90f0d7ce19 tempest-DeleteServersTestJSON-1339699680 None] Deleting attachment 0006c17b-b97b-4adc-a9f5-d671b2a958b3. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "cinder-1367c6c1-a322-4806-8b3b-a5fba834d710-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "cinder-1367c6c1-a322-4806-8b3b-a5fba834d710-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "cinder-quobyte-1367c6c1-a322-4806-8b3b-a5fba834d710" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "cinder-quobyte-1367c6c1-a322-4806-8b3b-a5fba834d710" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac569170-d600-4e03-af9b-459f928e3a02]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:14 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 Aug 05 15:47:14 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:14 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:15 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710 Aug 05 15:47:15 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:15 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1367c6c1-a322-4806-8b3b-a5fba834d710" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "cinder-quobyte-1367c6c1-a322-4806-8b3b-a5fba834d710" released by "delete_volume" :: held 0.700s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Created reservations ['01e90dda-93c2-451f-a563-979dc7c0f56e', '31e40f42-c5ef-484b-a07e-becfefef2f49', 'c295959b-c8b0-42a3-9e0b-a36b9a8e4329', 'd48f1890-67dd-415f-b952-2798d4baa23b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:15 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:47:15 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:15 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.316s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Deleted volume successfully. Aug 05 15:47:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-55ba6bf4-2dcf-43e4-b004-c9698db982df tempest-DeleteServersTestJSON-1339699680 None] Lock "cinder-1367c6c1-a322-4806-8b3b-a5fba834d710-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:25 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:25 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Flow 'volume_create_manager' (c4decb88-d09b-4f8f-9a7b-d14933adc338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1315f7-de31-40d2-ad02-4f82d1858abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1315f7-de31-40d2-ad02-4f82d1858abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-411256433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc67d31-fd17-4a22-bcdb-7540a716318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5060632b9e4f74ac6680d8136ccfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:29Z,use_quota=True,user_id='a9f452c254a24a87b3a55532942f12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feab8a9-dd71-45ae-bccd-5ff7213168c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feab8a9-dd71-45ae-bccd-5ff7213168c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc80fda0-442c-4533-8a50-8bc707f479b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc80fda0-442c-4533-8a50-8bc707f479b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc67d31-fd17-4a22-bcdb-7540a716318a', 'volume_name': 'volume-7dc67d31-fd17-4a22-bcdb-7540a716318a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9fb2df-61ce-4a89-a91b-24cae217ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9fb2df-61ce-4a89-a91b-24cae217ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e6abee-8bbf-498c-8cf2-2f533568bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Volume 7dc67d31-fd17-4a22-bcdb-7540a716318a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc67d31-fd17-4a22-bcdb-7540a716318a', 'volume_size': 1} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-411256433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc67d31-fd17-4a22-bcdb-7540a716318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5060632b9e4f74ac6680d8136ccfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:29Z,use_quota=True,user_id='a9f452c254a24a87b3a55532942f12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Creating volume 7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:29 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:29 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a 1073741824 Aug 05 15:47:29 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:29 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a 1073741824" returned: 0 in 0.631s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:29 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a Aug 05 15:47:29 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:29 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a" returned: 0 in 0.291s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e6abee-8bbf-498c-8cf2-2f533568bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc67d31-fd17-4a22-bcdb-7540a716318a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4c0d4-d4a3-4ad8-9d73-52f15cd27d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Volume volume-7dc67d31-fd17-4a22-bcdb-7540a716318a (7dc67d31-fd17-4a22-bcdb-7540a716318a): created successfully Aug 05 15:47:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4c0d4-d4a3-4ad8-9d73-52f15cd27d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Flow 'volume_create_manager' (c4decb88-d09b-4f8f-9a7b-d14933adc338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6e2f06c2-93c4-41cf-8924-bd224da68993 tempest-ServerActionsTestOtherA-521004922 None] Created volume successfully. Aug 05 15:47:40 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Flow 'volume_create_manager' (65244fb5-1381-43d5-9083-0a38a21f58cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8434dd-4b36-42e0-b6b9-a7cc1f939288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8434dd-4b36-42e0-b6b9-a7cc1f939288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1707007108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f43cea-0b60-49ff-a2c2-35eab89a67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2290f8b6e29d431e94501503a5ef2aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:46Z,use_quota=True,user_id='005fa51eeb234d998860c6abe9c1f734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c080d2c-f734-4ffb-b52b-862160f19c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c080d2c-f734-4ffb-b52b-862160f19c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7d0057-c595-404c-845d-e0eb27c69c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7d0057-c595-404c-845d-e0eb27c69c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f43cea-0b60-49ff-a2c2-35eab89a67ef', 'volume_name': 'volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c286ac-f2a3-4b5f-b621-feb61de4986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c286ac-f2a3-4b5f-b621-feb61de4986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e8dc4b-991d-496d-9bdd-f02168455b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:46 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Volume e6f43cea-0b60-49ff-a2c2-35eab89a67ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef', 'volume_size': 1} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1707007108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f43cea-0b60-49ff-a2c2-35eab89a67ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2290f8b6e29d431e94501503a5ef2aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:46Z,use_quota=True,user_id='005fa51eeb234d998860c6abe9c1f734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Creating volume e6f43cea-0b60-49ff-a2c2-35eab89a67ef {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:46 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:46 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef 1073741824 Aug 05 15:47:46 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:47 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef 1073741824" returned: 0 in 0.667s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:47 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef Aug 05 15:47:47 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:47 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e8dc4b-991d-496d-9bdd-f02168455b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d6301a-492a-477a-aa09-a48040269746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:47 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Volume volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef (e6f43cea-0b60-49ff-a2c2-35eab89a67ef): created successfully Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d6301a-492a-477a-aa09-a48040269746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Flow 'volume_create_manager' (65244fb5-1381-43d5-9083-0a38a21f58cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-51d19fb2-b679-4294-947b-672a015c19ff tempest-TaggedAttachmentsTest-1084406859 None] Created volume successfully. Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (dfbef87e-a578-4079-8130-a7f3432f0a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dd4f4b-312b-4773-b7bb-07400b8c1247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dd4f4b-312b-4773-b7bb-07400b8c1247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-769569174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6390ab3a-0925-415c-8e38-5f3441aabee6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:51Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a7bff1-ca07-44c0-92d4-c6621633d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a7bff1-ca07-44c0-92d4-c6621633d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dd75ec-d49f-4a84-8fcb-0b7e592e5962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22dd75ec-d49f-4a84-8fcb-0b7e592e5962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6390ab3a-0925-415c-8e38-5f3441aabee6', 'volume_name': 'volume-6390ab3a-0925-415c-8e38-5f3441aabee6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e346116-8585-46b0-b559-b1f1522ab48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e346116-8585-46b0-b559-b1f1522ab48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5cc3bc-20e0-4262-9a74-18bdc3af8ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Volume 6390ab3a-0925-415c-8e38-5f3441aabee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6390ab3a-0925-415c-8e38-5f3441aabee6', 'volume_size': 1} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-769569174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6390ab3a-0925-415c-8e38-5f3441aabee6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:51Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Creating volume 6390ab3a-0925-415c-8e38-5f3441aabee6 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:50 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:50 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 1073741824 Aug 05 15:47:50 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:51 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 1073741824" returned: 0 in 0.505s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:51 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 Aug 05 15:47:51 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:51 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5cc3bc-20e0-4262-9a74-18bdc3af8ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6390ab3a-0925-415c-8e38-5f3441aabee6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299466f-45a1-4171-a56e-40e19e922107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:51 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Volume volume-6390ab3a-0925-415c-8e38-5f3441aabee6 (6390ab3a-0925-415c-8e38-5f3441aabee6): created successfully Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299466f-45a1-4171-a56e-40e19e922107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (dfbef87e-a578-4079-8130-a7f3432f0a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-83be50fe-6d68-4b89-92a3-5f4dc2bde6ba tempest-VolumesTestJSON-1612618398 None] Created volume successfully. Aug 05 15:47:53 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (32413188-ebfc-4443-bcf3-72342432d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baacd2e7-f970-4c02-8367-c50aa30a341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baacd2e7-f970-4c02-8367-c50aa30a341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-204110559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4824ba-d95b-416a-9206-c770d3f53e1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:54Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fa39eb-f13e-44e1-8f54-932a99188073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fa39eb-f13e-44e1-8f54-932a99188073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa9cdd4-539a-44dc-9997-24d2d19a7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa9cdd4-539a-44dc-9997-24d2d19a7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4824ba-d95b-416a-9206-c770d3f53e1a', 'volume_name': 'volume-fd4824ba-d95b-416a-9206-c770d3f53e1a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2998f90-fd57-48e4-98b8-2b16336c1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2998f90-fd57-48e4-98b8-2b16336c1466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e68fc4-8ed5-431b-b03d-09502633c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Volume fd4824ba-d95b-416a-9206-c770d3f53e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4824ba-d95b-416a-9206-c770d3f53e1a', 'volume_size': 1} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-204110559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4824ba-d95b-416a-9206-c770d3f53e1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:54Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Creating volume fd4824ba-d95b-416a-9206-c770d3f53e1a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:54 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:54 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a 1073741824 Aug 05 15:47:54 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:55 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a 1073741824" returned: 0 in 1.091s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:55 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a Aug 05 15:47:55 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:56 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a" returned: 0 in 0.680s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e68fc4-8ed5-431b-b03d-09502633c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4824ba-d95b-416a-9206-c770d3f53e1a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80926df0-1bf2-4c85-95f9-ba6690160bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Volume volume-fd4824ba-d95b-416a-9206-c770d3f53e1a (fd4824ba-d95b-416a-9206-c770d3f53e1a): created successfully Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80926df0-1bf2-4c85-95f9-ba6690160bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (32413188-ebfc-4443-bcf3-72342432d29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8cf3739a-296d-444f-be39-a72f2621987f tempest-VolumesTestJSON-1612618398 None] Created volume successfully. Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (a4a95ad1-dd8b-40be-bcb7-1c0b407cbd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75e9a3-3411-4a50-9131-e2eaf592aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b75e9a3-3411-4a50-9131-e2eaf592aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1589483293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7066f9-9700-48cd-8e13-08ba72156bce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:58Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb8920-fe7c-4973-80a0-3a1098b62d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb8920-fe7c-4973-80a0-3a1098b62d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a07fa40-797b-4e13-98de-c5d6e655b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a07fa40-797b-4e13-98de-c5d6e655b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7066f9-9700-48cd-8e13-08ba72156bce', 'volume_name': 'volume-bf7066f9-9700-48cd-8e13-08ba72156bce', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b277648-ac70-4d8b-ad3f-10380e2a2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b277648-ac70-4d8b-ad3f-10380e2a2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99370608-d029-45be-8388-099f7d872402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Volume bf7066f9-9700-48cd-8e13-08ba72156bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7066f9-9700-48cd-8e13-08ba72156bce', 'volume_size': 1} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1589483293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7066f9-9700-48cd-8e13-08ba72156bce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='699e6a0de39e42b8a5ca1ac2cfcbd17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:58Z,use_quota=True,user_id='73418bd3ab24400f9c4f0741b30b3454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Creating volume bf7066f9-9700-48cd-8e13-08ba72156bce {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:47:58 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:47:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:58 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce 1073741824 Aug 05 15:47:58 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:59 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce 1073741824" returned: 0 in 0.797s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:59 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce Aug 05 15:47:59 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:59 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99370608-d029-45be-8388-099f7d872402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7066f9-9700-48cd-8e13-08ba72156bce', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1959499f-0142-467c-bf13-09226c5f3b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Volume volume-bf7066f9-9700-48cd-8e13-08ba72156bce (bf7066f9-9700-48cd-8e13-08ba72156bce): created successfully Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1959499f-0142-467c-bf13-09226c5f3b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Flow 'volume_create_manager' (a4a95ad1-dd8b-40be-bcb7-1c0b407cbd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-700bd493-a6d8-46d1-9cb2-7954226ade9b tempest-VolumesTestJSON-1612618398 None] Created volume successfully. Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:03 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:03 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:04 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.531s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:48:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 8 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:48:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-bf7066f9-9700-48cd-8e13-08ba72156bce-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-bf7066f9-9700-48cd-8e13-08ba72156bce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-quobyte-bf7066f9-9700-48cd-8e13-08ba72156bce" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-bf7066f9-9700-48cd-8e13-08ba72156bce" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b673104d-fb32-4656-bd62-fbbf66532fd7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:05 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce Aug 05 15:48:05 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:06 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce" returned: 0 in 0.918s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:06 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce Aug 05 15:48:06 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:07 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bf7066f9-9700-48cd-8e13-08ba72156bce" returned: 0 in 0.576s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-bf7066f9-9700-48cd-8e13-08ba72156bce" released by "delete_volume" :: held 1.565s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Created reservations ['0ddeaf9d-8d1e-4260-a249-62c2bafe47c8', '498a1ab6-5222-4a8b-b718-4b9f3216d304', '7aa2d45a-16a5-430e-bb4a-ba0b0c6dcf25', '8f1b165d-b6ae-4db4-a29e-8865f37832e9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:07 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:07 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:07 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.445s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Deleted volume successfully. Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b67fd66f-1c00-4029-ad67-30d7c9982db4 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-bf7066f9-9700-48cd-8e13-08ba72156bce-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-fd4824ba-d95b-416a-9206-c770d3f53e1a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-fd4824ba-d95b-416a-9206-c770d3f53e1a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-quobyte-fd4824ba-d95b-416a-9206-c770d3f53e1a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-fd4824ba-d95b-416a-9206-c770d3f53e1a" acquired by "delete_volume" :: waited 0.034s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:08 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ea590-d9bb-421d-ab79-02bd99f78349]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:08 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a Aug 05 15:48:08 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:09 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a" returned: 0 in 0.973s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:09 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a Aug 05 15:48:09 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:09 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fd4824ba-d95b-416a-9206-c770d3f53e1a" returned: 0 in 0.518s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-fd4824ba-d95b-416a-9206-c770d3f53e1a" released by "delete_volume" :: held 1.577s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Created reservations ['3fe80d88-af68-4ce2-9936-9b508bcb9b80', '49d6027b-af7e-4bce-afe2-fdd65750e165', '60d24bd5-eda3-42df-a469-7011a0afdb88', '52ac7b40-30aa-4026-87cc-1462edf0521d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:10 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:10 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:10 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.640s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Deleted volume successfully. Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3094a636-06ae-4b07-9ff9-2360478d2255 tempest-VolumesTestJSON-1612618398 None] Lock "cinder-fd4824ba-d95b-416a-9206-c770d3f53e1a-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-6390ab3a-0925-415c-8e38-5f3441aabee6-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "cinder-6390ab3a-0925-415c-8e38-5f3441aabee6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Acquiring lock "cinder-quobyte-6390ab3a-0925-415c-8e38-5f3441aabee6" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-6390ab3a-0925-415c-8e38-5f3441aabee6" acquired by "delete_volume" :: waited 0.044s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54cf7d1-6b78-49d8-a95e-5fcc3248f1b6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:11 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 Aug 05 15:48:11 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:12 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6" returned: 0 in 1.054s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:12 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6 Aug 05 15:48:12 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:12 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6390ab3a-0925-415c-8e38-5f3441aabee6" returned: 0 in 0.568s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "cinder-quobyte-6390ab3a-0925-415c-8e38-5f3441aabee6" released by "delete_volume" :: held 1.734s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Created reservations ['1dabd492-0735-48e6-a5fa-41ff0fb2e73f', 'f0088160-c7e5-4d6e-9e11-2acec3f88e29', 'eb066c6e-4f87-4851-9ee2-9a0a744c950b', '8701fbe1-9755-4c03-a65d-09f4c11b87e8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:13 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:13 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:13 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.642s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:13 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Deleted volume successfully. Aug 05 15:48:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-98b4aeff-a18d-4682-a44f-88d4ecca89dd tempest-VolumesTestJSON-1612618398 None] Lock "cinder-6390ab3a-0925-415c-8e38-5f3441aabee6-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e114d11a-fe0b-46bf-b784-a4e02bb2f7b8 tempest-GroupSnapshotsV319Test-667316735 None] Group tempest-GroupSnapshotsV319Test-Group-174555172: creating Aug 05 15:48:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e114d11a-fe0b-46bf-b784-a4e02bb2f7b8 tempest-GroupSnapshotsV319Test-667316735 None] Group tempest-GroupSnapshotsV319Test-Group-174555172: created successfully Aug 05 15:48:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e114d11a-fe0b-46bf-b784-a4e02bb2f7b8 tempest-GroupSnapshotsV319Test-667316735 None] Create group completed successfully. Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Flow 'volume_create_manager' (f7ac1496-8ad5-4835-a937-3788060e4159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67c216-f435-404d-9e35-c973a6bab547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67c216-f435-404d-9e35-c973a6bab547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023152286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95d393d-1816-4980-9988-dc5978d1997c,host='devstack@QuobyteHD#QuobyteHD',id=28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21e12618c174c38bc5d69a7bf37f33a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:22Z,use_quota=True,user_id='467544fa2d6d41f393f1a75cc9c0b68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3c5841b-e4f7-405f-bccc-bd7122a2eb87),volume_type_id=c3c5841b-e4f7-405f-bccc-bd7122a2eb87)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fba49f-94da-4009-b111-0e02dbe400ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fba49f-94da-4009-b111-0e02dbe400ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e5c4ae-e4c7-4463-9ab1-be65e4edce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e5c4ae-e4c7-4463-9ab1-be65e4edce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807', 'volume_name': 'volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7b2d12-a3d7-44e8-aff3-dd12c34037a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7b2d12-a3d7-44e8-aff3-dd12c34037a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9ffe98-bf3a-407c-9ec9-749f9525ce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Volume 28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807', 'volume_size': 1} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a95d393d-1816-4980-9988-dc5978d1997c,created_at=2026-08-05T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1023152286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95d393d-1816-4980-9988-dc5978d1997c,host='devstack@QuobyteHD#QuobyteHD',id=28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21e12618c174c38bc5d69a7bf37f33a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:22Z,use_quota=True,user_id='467544fa2d6d41f393f1a75cc9c0b68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3c5841b-e4f7-405f-bccc-bd7122a2eb87),volume_type_id=c3c5841b-e4f7-405f-bccc-bd7122a2eb87)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Creating volume 28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:48:22 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:22 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 1073741824 Aug 05 15:48:22 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Flow 'volume_create_manager' (e54d1d1a-7b4a-4617-8215-ea8260210ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf2d542-1ecc-48bf-9554-ccdc7a24281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf2d542-1ecc-48bf-9554-ccdc7a24281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022839829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5367d864-1837-4c85-862e-8fc3ea22cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5237c3d5108f4483be23db8e92f2ae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:23Z,use_quota=True,user_id='b766f1b375f74a7aa95715aef09f0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640680d7-8d5b-4430-9c61-122a241b3e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640680d7-8d5b-4430-9c61-122a241b3e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb47f0e-5f14-4ee4-8697-cbcb74431392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb47f0e-5f14-4ee4-8697-cbcb74431392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5367d864-1837-4c85-862e-8fc3ea22cd3b', 'volume_name': 'volume-5367d864-1837-4c85-862e-8fc3ea22cd3b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a7be31-3e35-4d70-ac20-80bc0dfb25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a7be31-3e35-4d70-ac20-80bc0dfb25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c1cf38-23bf-4801-8564-73f0bcd22646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Volume 5367d864-1837-4c85-862e-8fc3ea22cd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5367d864-1837-4c85-862e-8fc3ea22cd3b', 'volume_size': 1} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:22 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 1073741824" returned: 0 in 0.475s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:22 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 Aug 05 15:48:22 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:23 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022839829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5367d864-1837-4c85-862e-8fc3ea22cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5237c3d5108f4483be23db8e92f2ae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:23Z,use_quota=True,user_id='b766f1b375f74a7aa95715aef09f0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Creating volume 5367d864-1837-4c85-862e-8fc3ea22cd3b {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:48:23 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9ffe98-bf3a-407c-9ec9-749f9525ce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1d2f55-2837-4563-a5d3-8fcfba287275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:23 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b 1073741824 Aug 05 15:48:23 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:23 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Volume volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 (28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807): created successfully Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1d2f55-2837-4563-a5d3-8fcfba287275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Flow 'volume_create_manager' (f7ac1496-8ad5-4835-a937-3788060e4159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-35af7b41-e10b-44de-9831-d96a2ec2a6a0 tempest-GroupSnapshotsV319Test-667316735 None] Created volume successfully. Aug 05 15:48:23 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b 1073741824" returned: 0 in 0.544s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:23 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b Aug 05 15:48:23 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] GroupSnapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: creating. Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Group snapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: creating. {{(pid=88715) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:48:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:24 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.105s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c1cf38-23bf-4801-8564-73f0bcd22646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5367d864-1837-4c85-862e-8fc3ea22cd3b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3ce9f2-234e-43d8-acd9-b7fe260d39be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Creating offline snapshot e163e102-27e5-47ee-a05d-e8721ecd6f11 of volume 28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:48:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Volume volume-5367d864-1837-4c85-862e-8fc3ea22cd3b (5367d864-1837-4c85-862e-8fc3ea22cd3b): created successfully Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3ce9f2-234e-43d8-acd9-b7fe260d39be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Flow 'volume_create_manager' (e54d1d1a-7b4a-4617-8215-ea8260210ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf0bf3-e114-408c-bb24-90d80611ac9e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:24 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5444cd04-9366-412e-af42-4b3a82099f08 tempest-ServersNegativeTestJSON-2068673078 None] Created volume successfully. Aug 05 15:48:24 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 Aug 05 15:48:24 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:24 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" returned: 0 in 0.445s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:24 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 1G Aug 05 15:48:24 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:25 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 1G" returned: 0 in 0.659s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:25 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 Aug 05 15:48:25 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:25 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11" returned: 0 in 0.331s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:25 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:25 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 Aug 05 15:48:25 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:25 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=43,cinder:UPDATE=45,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:25 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info Aug 05 15:48:25 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:26 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:26 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:26 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info Aug 05 15:48:26 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Flow 'volume_create_manager' (43ad3f7b-13ea-4851-b4bd-7a88f3de9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764d7dd4-c26c-4345-a76a-24487fb5e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764d7dd4-c26c-4345-a76a-24487fb5e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-684503605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d67d96d-2cd3-40d7-8e82-1c625ed142b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5237c3d5108f4483be23db8e92f2ae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:26Z,use_quota=True,user_id='b766f1b375f74a7aa95715aef09f0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d173ff8-42b2-4615-8ff8-16f15f06deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d173ff8-42b2-4615-8ff8-16f15f06deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1e8f28-7cb5-4481-b066-d291366f1d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1e8f28-7cb5-4481-b066-d291366f1d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d67d96d-2cd3-40d7-8e82-1c625ed142b8', 'volume_name': 'volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b1327d-9b9e-41c8-a48c-38de946c0ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b1327d-9b9e-41c8-a48c-38de946c0ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546c7e58-5508-42d8-8756-6fb4dfcd54a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Volume 5d67d96d-2cd3-40d7-8e82-1c625ed142b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8', 'volume_size': 1} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:26 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.info" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.194s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce72a91-f5ec-4896-8b0b-bd186f93f22f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9ccf432b-b29e-4706-b74b-6635c906c646 tempest-GroupSnapshotsV319Test-667316735 None] group_snapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: created successfully Aug 05 15:48:26 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a Aug 05 15:48:26 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:26 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a" returned: 0 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.412s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-684503605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d67d96d-2cd3-40d7-8e82-1c625ed142b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5237c3d5108f4483be23db8e92f2ae6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:26Z,use_quota=True,user_id='b766f1b375f74a7aa95715aef09f0d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Creating volume 5d67d96d-2cd3-40d7-8e82-1c625ed142b8 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:48:26 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:26 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 1073741824 Aug 05 15:48:26 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-7dc67d31-fd17-4a22-bcdb-7540a716318a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04970f63-6cea-413a-8b52-82f3aa614602', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:48:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-df10209f-3b9d-42bd-a646-2419e6774b66 req-b1302811-1473-47bd-935a-e74869ea851d tempest-ServerActionsTestOtherA-521004922 None] attachment_update completed successfully. Aug 05 15:48:27 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 1073741824" returned: 0 in 0.507s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:27 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 Aug 05 15:48:27 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:27 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" returned: 0 in 0.275s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546c7e58-5508-42d8-8756-6fb4dfcd54a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8792bf70-c5e4-48b6-91b5-c399fe05c6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Volume volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 (5d67d96d-2cd3-40d7-8e82-1c625ed142b8): created successfully Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8792bf70-c5e4-48b6-91b5-c399fe05c6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Flow 'volume_create_manager' (43ad3f7b-13ea-4851-b4bd-7a88f3de9e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9c922270-7933-469a-9b93-0cf077dfed15 tempest-ServersNegativeTestJSON-2068673078 None] Created volume successfully. Aug 05 15:48:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] group_snapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: deleting Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] group_snapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: deleting {{(pid=88715) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "cinder-quobyte-e163e102-27e5-47ee-a05d-e8721ecd6f11" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-e163e102-27e5-47ee-a05d-e8721ecd6f11" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Deleting offline snapshot e163e102-27e5-47ee-a05d-e8721ecd6f11 of volume 28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] snapshot_file for this snap is: volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeebab7-6987-49fe-85da-80c9d1136490]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:28 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 Aug 05 15:48:28 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:28 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[69322ed2-fa91-41fe-a97b-7664d8be7190]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:28 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 Aug 05 15:48:28 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:28 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" returned: 0 in 0.414s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:28 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 Aug 05 15:48:28 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "cinder-5d67d96d-2cd3-40d7-8e82-1c625ed142b8-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-5d67d96d-2cd3-40d7-8e82-1c625ed142b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "cinder-quobyte-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-quobyte-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd039f01-b59c-437f-9f2c-1bf97e73e7e3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 Aug 05 15:48:29 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11 Aug 05 15:48:29 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" returned: 0 in 0.497s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807.e163e102-27e5-47ee-a05d-e8721ecd6f11" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8 Aug 05 15:48:29 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-e163e102-27e5-47ee-a05d-e8721ecd6f11" released by "_delete_snapshot" :: held 1.599s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" released by "delete_snapshot" :: held 1.629s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:29 devstack cinder-volume[88715]: WARNING cinder.quota [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2003614582 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2003614582, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:48:29 devstack cinder-volume[88715]: WARNING cinder.quota [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2003614582 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2003614582, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] Created reservations ['e0e6cf8c-5a7d-4ba7-903f-3a55c874a692', 'fed3c797-0d1c-4aee-b43c-6e183876318d', '069934ed-e8ac-4caf-8bed-ccd716ff4381', '254dfe4e-7637-49e0-9985-45431f654948'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fdb8161b-14e8-4cd1-88a6-e61f8c1138c0 tempest-GroupSnapshotsV319Test-667316735 None] group_snapshot 7c39c733-a8c5-478d-ae77-5bf66d61abd6: deleted successfully Aug 05 15:48:29 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-quobyte-5d67d96d-2cd3-40d7-8e82-1c625ed142b8" released by "delete_volume" :: held 0.854s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Created reservations ['14d64893-1348-4d7a-aa43-a0e2b781395f', '1dcc29c3-acc7-4077-ae6c-61a7cdbf3ca8', '24595a5b-e7df-462e-b11b-6ff8a2a304d8', '31b37297-5aff-44a0-83fc-584566e48390'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:29 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "cinder-5367d864-1837-4c85-862e-8fc3ea22cd3b-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-5367d864-1837-4c85-862e-8fc3ea22cd3b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "cinder-quobyte-5367d864-1837-4c85-862e-8fc3ea22cd3b" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-quobyte-5367d864-1837-4c85-862e-8fc3ea22cd3b" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[752da897-4c56-4cf7-8b71-cfd449a29b70]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:30 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Deleted volume successfully. Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bf3153f8-0152-4606-958a-87d886ba8ad8 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-5d67d96d-2cd3-40d7-8e82-1c625ed142b8-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:30 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b Aug 05 15:48:30 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-913b2557-3581-48c1-8419-ed2cc6be059c tempest-ServerActionsTestOtherA-521004922 None] Terminate volume connection completed successfully. Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-913b2557-3581-48c1-8419-ed2cc6be059c tempest-ServerActionsTestOtherA-521004922 None] Deleting attachment 04970f63-6cea-413a-8b52-82f3aa614602. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:30 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b" returned: 0 in 0.496s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[543fbd5e-66e6-48bc-829f-5ac7c077b93f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:30 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b Aug 05 15:48:30 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:30 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 Aug 05 15:48:30 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5367d864-1837-4c85-862e-8fc3ea22cd3b" returned: 0 in 0.443s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-quobyte-5367d864-1837-4c85-862e-8fc3ea22cd3b" released by "delete_volume" :: held 1.001s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Created reservations ['574b52ad-e110-489d-bfcf-b380ff398ef9', '9f94fbc9-10df-4b16-b774-ac815c41d533', '029b99e4-782f-45db-a745-85ff3cf4c582', '592e73af-812e-4854-8750-742645066876'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:31 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" returned: 0 in 0.730s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:31 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807 Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:31 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:31 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e760fbd2-6f7c-43b9-a2f7-1842121987de]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:31 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a Aug 05 15:48:31 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Lock "cinder-quobyte-28b5c5ec-b1f4-4b7f-8b91-72a18a2b4807" released by "delete_volume" :: held 1.105s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:31 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.328s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Deleted volume successfully. Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91f348f9-2e17-4b64-843d-2b2467a8d2f4 tempest-ServersNegativeTestJSON-2068673078 None] Lock "cinder-5367d864-1837-4c85-862e-8fc3ea22cd3b-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Created reservations ['56f9125e-4734-4ddd-8095-29b7f8c09077'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:31 devstack cinder-volume[88715]: WARNING cinder.quota [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2003614582 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2003614582, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:48:31 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Created reservations ['ca7988a5-20d5-4419-a5e2-a19687f29185', 'b92247ba-b492-4835-82c4-da8264ca0817', 'b9d92d8a-9733-444e-a7d0-dfa0624200c3', 'ed6f3a57-a269-4891-8df4-f753df74a5bc'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:32 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a" returned: 0 in 0.446s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.473s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:32 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:48:32 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-7dc67d31-fd17-4a22-bcdb-7540a716318a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47ad2337-1cb3-4b82-a1b1-9101c1ad74bd', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:48:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-b7fda3b3-ecca-459e-adc6-0a6abb7b3b0d req-f92fc9e3-49b3-45e9-9f76-4dc112573006 tempest-ServerActionsTestOtherA-521004922 None] attachment_update completed successfully. Aug 05 15:48:32 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:32 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d9e640fe-1bcc-4602-b7ca-b474dd341526 tempest-GroupSnapshotsV319Test-667316735 None] Delete group completed successfully. Aug 05 15:48:42 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=33,cinder:SELECT=44,cinder:INSERT=10,cinder:DELETE=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:42 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=93,cinder:SELECT=64,cinder:DELETE=6,cinder:INSERT=18 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f36fc9-7527-484b-a658-32ba9e60947e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:44 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef Aug 05 15:48:44 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:44 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" returned: 0 in 0.584s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.624s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bd7dc66-1857-48e7-b64d-fa85a3694fd0', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:48:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-707a17ed-4ae7-459e-9e8b-b8787c4ebef4 req-89ac43d1-c903-4144-9069-cfa4c4d5964e tempest-TaggedAttachmentsTest-1084406859 None] attachment_update completed successfully. Aug 05 15:48:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-f13568b5-1d87-42db-9011-a126ad0e9e1b req-6a01fcb3-2b73-42fe-820e-4e501881f516 tempest-TaggedAttachmentsTest-1084406859 None] Terminate volume connection completed successfully. Aug 05 15:48:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-f13568b5-1d87-42db-9011-a126ad0e9e1b req-6a01fcb3-2b73-42fe-820e-4e501881f516 tempest-TaggedAttachmentsTest-1084406859 None] Deleting attachment 8bd7dc66-1857-48e7-b64d-fa85a3694fd0. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (98aa5ff3-8ebb-4bf5-a16c-ea3ad3562f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f94d77-35e7-4044-b738-2fb17ff262b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f94d77-35e7-4044-b738-2fb17ff262b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1932868142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07db9675-6b08-4c8e-916a-e27e6371d0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:58Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97381436-a720-4341-a36a-23cda455cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97381436-a720-4341-a36a-23cda455cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a56442c-f9bc-4b55-a0cf-9a64c589ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a56442c-f9bc-4b55-a0cf-9a64c589ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07db9675-6b08-4c8e-916a-e27e6371d0a2', 'volume_name': 'volume-07db9675-6b08-4c8e-916a-e27e6371d0a2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b156aa-a7fe-4f6c-954f-ce62654a4fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b156aa-a7fe-4f6c-954f-ce62654a4fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7b1cd-ab8f-441f-9dc5-9945508d043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Volume 07db9675-6b08-4c8e-916a-e27e6371d0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07db9675-6b08-4c8e-916a-e27e6371d0a2', 'volume_size': 1} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1932868142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07db9675-6b08-4c8e-916a-e27e6371d0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:58Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Creating volume 07db9675-6b08-4c8e-916a-e27e6371d0a2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:48:58 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:58 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 1073741824 Aug 05 15:48:58 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:58 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 1073741824" returned: 0 in 0.647s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:58 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 Aug 05 15:48:58 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:59 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2" returned: 0 in 0.327s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7b1cd-ab8f-441f-9dc5-9945508d043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07db9675-6b08-4c8e-916a-e27e6371d0a2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c8a71b-489e-49aa-8b8d-25daa904b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Volume volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 (07db9675-6b08-4c8e-916a-e27e6371d0a2): created successfully Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c8a71b-489e-49aa-8b8d-25daa904b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (98aa5ff3-8ebb-4bf5-a16c-ea3ad3562f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-26fb4528-2cda-49bc-9e34-4544893c24da tempest-VolumesListAdminTestJSON-1093484094 None] Created volume successfully. Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (2e3857d3-b4aa-473e-afd6-dfb1441d05a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb3ef3d-ac9e-494f-aab3-9e09d2d993b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb3ef3d-ac9e-494f-aab3-9e09d2d993b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-63130034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66ab7f3-0582-437a-9f09-a549e90d4233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:01Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbe93cc-78d1-4435-b559-c2b8d41aa451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbe93cc-78d1-4435-b559-c2b8d41aa451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f005328-f934-4476-a81c-394d7f02aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f005328-f934-4476-a81c-394d7f02aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66ab7f3-0582-437a-9f09-a549e90d4233', 'volume_name': 'volume-f66ab7f3-0582-437a-9f09-a549e90d4233', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8748e171-ee27-4a8e-8f9e-0145f286aaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8748e171-ee27-4a8e-8f9e-0145f286aaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9d026b-75d9-41c0-95c7-c4bc6e45cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Volume f66ab7f3-0582-437a-9f09-a549e90d4233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66ab7f3-0582-437a-9f09-a549e90d4233', 'volume_size': 1} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-63130034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66ab7f3-0582-437a-9f09-a549e90d4233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:01Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Creating volume f66ab7f3-0582-437a-9f09-a549e90d4233 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:00 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:01 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 1073741824 Aug 05 15:49:01 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:01 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 1073741824" returned: 0 in 0.584s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:01 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 Aug 05 15:49:01 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-f43d5acc-793e-4dd6-b172-362a2b0fc622 req-9091cfb1-df39-4dc3-92c6-273780d160a6 tempest-ServerActionsTestOtherA-521004922 None] Terminate volume connection completed successfully. Aug 05 15:49:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-f43d5acc-793e-4dd6-b172-362a2b0fc622 req-9091cfb1-df39-4dc3-92c6-273780d160a6 tempest-ServerActionsTestOtherA-521004922 None] Deleting attachment 47ad2337-1cb3-4b82-a1b1-9101c1ad74bd. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:49:02 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9d026b-75d9-41c0-95c7-c4bc6e45cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66ab7f3-0582-437a-9f09-a549e90d4233', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be28117-e3f1-4548-a69e-587820474b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Volume volume-f66ab7f3-0582-437a-9f09-a549e90d4233 (f66ab7f3-0582-437a-9f09-a549e90d4233): created successfully Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be28117-e3f1-4548-a69e-587820474b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (2e3857d3-b4aa-473e-afd6-dfb1441d05a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-425fd951-4f00-40c0-9647-3f28f075e682 tempest-VolumesListAdminTestJSON-1093484094 None] Created volume successfully. Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "cinder-e6f43cea-0b60-49ff-a2c2-35eab89a67ef-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:03 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "cinder-e6f43cea-0b60-49ff-a2c2-35eab89a67ef-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:03 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "cinder-quobyte-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "cinder-quobyte-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" acquired by "delete_volume" :: waited 0.047s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4533313-034f-4db5-b5f8-937707684eb7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:04 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef Aug 05 15:49:04 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:04 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.479s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (6e762beb-4baa-4a84-bef4-8fe695a40ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68f74c9-981e-4ec1-833c-37d53c070fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68f74c9-981e-4ec1-833c-37d53c070fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-926373162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dc9ae7-e290-4f91-837f-e3892ceaff92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:04Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a338b29c-01be-45bf-9fbf-4e3c60643ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a338b29c-01be-45bf-9fbf-4e3c60643ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f564b93b-3668-4204-bea6-6125aec328b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f564b93b-3668-4204-bea6-6125aec328b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85dc9ae7-e290-4f91-837f-e3892ceaff92', 'volume_name': 'volume-85dc9ae7-e290-4f91-837f-e3892ceaff92', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01163c3-6669-40be-94f0-475296321ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01163c3-6669-40be-94f0-475296321ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c57592-2a70-4111-a52c-48f8133d486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Volume 85dc9ae7-e290-4f91-837f-e3892ceaff92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85dc9ae7-e290-4f91-837f-e3892ceaff92', 'volume_size': 1} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-926373162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dc9ae7-e290-4f91-837f-e3892ceaff92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d934e333d76c4cd0bf1815208cdc224d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:04Z,use_quota=True,user_id='bd8be0ced1e24234a355552f90620f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Creating volume 85dc9ae7-e290-4f91-837f-e3892ceaff92 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:04 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:04 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 1073741824 Aug 05 15:49:04 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:04 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" returned: 0 in 0.528s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:04 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef Aug 05 15:49:04 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:04 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "cinder-quobyte-e6f43cea-0b60-49ff-a2c2-35eab89a67ef" released by "delete_volume" :: held 0.937s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Created reservations ['9c965786-d3bb-4ddd-9d7e-a4944e92d99c', 'a66732e1-5b2d-4f4b-b1bf-f5a544a673f6', 'f0b8019c-fcdd-4332-a259-4a60334acc8c', 'de8d324e-de79-42da-bfab-a22bd73c075d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:04 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 1073741824" returned: 0 in 0.645s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:05 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:05 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:05 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 Aug 05 15:49:05 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:05 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.361s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Deleted volume successfully. Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-41396e2a-753e-40e1-8e5d-c5e048a591fa tempest-TaggedAttachmentsTest-1084406859 None] Lock "cinder-e6f43cea-0b60-49ff-a2c2-35eab89a67ef-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:05 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92" returned: 0 in 0.464s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c57592-2a70-4111-a52c-48f8133d486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dc9ae7-e290-4f91-837f-e3892ceaff92', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2845c7e-8029-4c0c-ac3a-f7fa0f7c4e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Volume volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 (85dc9ae7-e290-4f91-837f-e3892ceaff92): created successfully Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2845c7e-8029-4c0c-ac3a-f7fa0f7c4e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Flow 'volume_create_manager' (6e762beb-4baa-4a84-bef4-8fe695a40ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fc684d2a-4aa1-4e8c-9eff-7a2cedab4950 tempest-VolumesListAdminTestJSON-1093484094 None] Created volume successfully. Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Flow 'volume_create_manager' (3eea2b04-7a31-49ae-8218-9943df3bf2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518e566d-38c2-4416-a1c1-75487c965fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518e566d-38c2-4416-a1c1-75487c965fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ced7f4c37344e569d87e9bc576a153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:07Z,use_quota=True,user_id='c0230ec6024747d7aa1faeb3e4df1af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b80615-9d5a-4525-9382-a09ac05fc854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b80615-9d5a-4525-9382-a09ac05fc854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c486d47-7db9-479a-9e49-6ecf20234aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c486d47-7db9-479a-9e49-6ecf20234aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a', 'volume_name': 'volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2113eb-e826-49a1-a034-c9f7460d9b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2113eb-e826-49a1-a034-c9f7460d9b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1154a6a5-4f51-4f72-a49d-a411567db1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:07 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Volume 8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a', 'volume_size': 1} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ced7f4c37344e569d87e9bc576a153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:07Z,use_quota=True,user_id='c0230ec6024747d7aa1faeb3e4df1af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Creating volume 8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:07 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:07 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a 1073741824 Aug 05 15:49:07 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:08 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a 1073741824" returned: 0 in 0.669s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:08 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a Aug 05 15:49:08 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:08 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" returned: 0 in 0.325s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1154a6a5-4f51-4f72-a49d-a411567db1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211b0bac-0921-46bd-b9bd-a8ce20ad771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:08 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Volume volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a (8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a): created successfully Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211b0bac-0921-46bd-b9bd-a8ce20ad771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Flow 'volume_create_manager' (3eea2b04-7a31-49ae-8218-9943df3bf2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bd5cfea6-1eef-4d87-a70a-a37a4623285a tempest-VolumesListAdminTestJSON-198271480 None] Created volume successfully. Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Acquiring lock "cinder-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "cinder-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Acquiring lock "cinder-quobyte-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "cinder-quobyte-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f430c25c-f05b-4b60-9eaa-66fa79c00e87]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-85dc9ae7-e290-4f91-837f-e3892ceaff92-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-85dc9ae7-e290-4f91-837f-e3892ceaff92-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-quobyte-85dc9ae7-e290-4f91-837f-e3892ceaff92" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-85dc9ae7-e290-4f91-837f-e3892ceaff92" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa112e63-f1dc-416b-adac-a928f6ff8f4b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:10 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a Aug 05 15:49:10 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:10 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 Aug 05 15:49:10 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:10 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" returned: 0 in 0.588s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:10 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a Aug 05 15:49:10 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:10 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92" returned: 0 in 0.640s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:10 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92 Aug 05 15:49:10 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:11 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:11 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" returned: 0 in 0.582s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-85dc9ae7-e290-4f91-837f-e3892ceaff92" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-85dc9ae7-e290-4f91-837f-e3892ceaff92" released by "delete_volume" :: held 1.103s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "cinder-quobyte-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a" released by "delete_volume" :: held 1.268s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Flow 'volume_create_manager' (b9eb9669-8ac9-4fec-b301-5c9abe50d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd365a2e-bf35-47dc-99da-ebd44ab19352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd365a2e-bf35-47dc-99da-ebd44ab19352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129235595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf91c91-a5eb-4a43-a70f-eb731f4f29eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5060632b9e4f74ac6680d8136ccfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:11Z,use_quota=True,user_id='a9f452c254a24a87b3a55532942f12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a39812-a47c-4fd4-b645-97ea1e351279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a39812-a47c-4fd4-b645-97ea1e351279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166336d8-2a00-4f75-be3b-023088f99c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Created reservations ['f104cfb6-2b9d-4554-ab4a-152e2bf398dd', 'f377ef6a-56e8-4f3f-9ee2-29a39fd31f13', 'a07313e2-6537-48c0-ac03-262c9eba3d72', '681f625b-b1ef-4729-b355-dd34514d99ac'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Created reservations ['c9f5b162-0828-4aca-a891-5f77b57e57c6', 'f4e8fa73-8f65-4ff6-a185-5e90deccdbd3', 'f1078d2c-cb23-46e1-b571-2f55dd5824b5', 'dcc60396-26b1-4d80-bcc9-284df7670144'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:11 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:11 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:11 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:11 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:12 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Deleted volume successfully. Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-595d5b5d-e5e0-40a0-914a-60d4c50a70f6 tempest-VolumesListAdminTestJSON-198271480 None] Lock "cinder-8bf3c688-e8f7-43af-b6ca-23bf4b0a1c1a-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166336d8-2a00-4f75-be3b-023088f99c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'volume_name': 'volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e38fb4-9ff4-4d91-85c0-ae5e71b87992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e38fb4-9ff4-4d91-85c0-ae5e71b87992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108506f-8168-4837-99e1-51d3688d9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Trying to clone 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:49:12 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.500s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Deleted volume successfully. Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0a857ef-08c0-41f0-9683-3e6d179a50bc tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-85dc9ae7-e290-4f91-837f-e3892ceaff92-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-f66ab7f3-0582-437a-9f09-a549e90d4233-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-f66ab7f3-0582-437a-9f09-a549e90d4233-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-quobyte-f66ab7f3-0582-437a-9f09-a549e90d4233" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-f66ab7f3-0582-437a-9f09-a549e90d4233" acquired by "delete_volume" :: waited 0.041s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc80cb-6aa3-4606-b9f6-a415edce52ae]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:49:12 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f576ef7-1d12-4fec-a63c-06915cfe2ad6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:12 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 Aug 05 15:49:12 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:13 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD Aug 05 15:49:13 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:13 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad is fetched for user a9f452c254a24a87b3a55532942f12e0. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:49:13 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233" returned: 0 in 0.595s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:13 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233 Aug 05 15:49:13 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[18985112-f41e-4773-be5a-cffb417e94e4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:13 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD Aug 05 15:49:13 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:13 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f66ab7f3-0582-437a-9f09-a549e90d4233" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-f66ab7f3-0582-437a-9f09-a549e90d4233" released by "delete_volume" :: held 0.958s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Created reservations ['4b634323-1684-4adb-92e3-f7fc8903de18', '5a25d6e3-0e82-4e6c-b030-4bcc36045c9f', '04331309-fac3-4efc-9f41-88269b909529', '4ff6bbd1-a21e-414d-82ca-de3572492b9d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:13 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129235595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf91c91-a5eb-4a43-a70f-eb731f4f29eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5060632b9e4f74ac6680d8136ccfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:11Z,use_quota=True,user_id='a9f452c254a24a87b3a55532942f12e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Creating volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:13 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:13 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1073741824 Aug 05 15:49:13 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:14 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:14 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:14 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Deleted volume successfully. Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21fe94b6-f287-40d1-b940-a8f0f4765396 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-f66ab7f3-0582-437a-9f09-a549e90d4233-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:14 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1073741824" returned: 0 in 0.597s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:14 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:14 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:14 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 0.362s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:14 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Attempting download of 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-07db9675-6b08-4c8e-916a-e27e6371d0a2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-07db9675-6b08-4c8e-916a-e27e6371d0a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[65661a30-b55d-4e8e-8851-fa241e9861a3]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "cinder-quobyte-07db9675-6b08-4c8e-916a-e27e6371d0a2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-07db9675-6b08-4c8e-916a-e27e6371d0a2" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[76abc18f-15d7-4964-8fdf-4817bdf04bdc]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:15 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma Aug 05 15:49:15 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:15 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 Aug 05 15:49:15 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:15 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma" returned: 0 in 0.458s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:15 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma Aug 05 15:49:15 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:15 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2" returned: 0 in 0.780s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:16 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2 Aug 05 15:49:16 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:16 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma" returned: 1 in 0.613s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_u99_62ma' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0ca956-1826-444c-bad0-e20353fd8113]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:16 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD Aug 05 15:49:16 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:16 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-07db9675-6b08-4c8e-916a-e27e6371d0a2" returned: 0 in 0.573s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-quobyte-07db9675-6b08-4c8e-916a-e27e6371d0a2" released by "delete_volume" :: held 1.424s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Created reservations ['f2d3d161-9bd9-438e-ac1b-5708c66e6942', '88928df6-0e48-4f52-b32b-8b4d4fa1a54f', '598ca6ac-2ba1-4f9e-a92d-74c0074d93c0', '7fada61c-2f1e-4407-8f62-d388a5c95ecf'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:16 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD" returned: 0 in 0.677s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:16 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:16 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:16 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:16 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:17 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.483s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:17 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Deleted volume successfully. Aug 05 15:49:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a8645585-fa7d-4294-acec-8c229e0d8f51 tempest-VolumesListAdminTestJSON-1093484094 None] Lock "cinder-07db9675-6b08-4c8e-916a-e27e6371d0a2-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:19 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 2.544s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:19 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_ibcafuy9devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:49:19 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Converted 112.00 MB image at 44.00 MB/s Aug 05 15:49:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:19 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1G Aug 05 15:49:19 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:19 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb 1G" returned: 0 in 0.571s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4a0bf-4293-4821-9a6b-cf57e50aa436]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:20 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:20 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:20 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 0.651s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:20 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:20 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:21 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 1 in 0.521s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Downloaded image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad for user a9f452c254a24a87b3a55532942f12e0 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Marking volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Copying metadata from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad to 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Creating volume glance metadata for volume 3cf91c91-a5eb-4a43-a70f-eb731f4f29eb backed by image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108506f-8168-4837-99e1-51d3688d9aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2751850-7d18-4816-9ef7-870a3e1331d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:21 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Volume volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb (3cf91c91-a5eb-4a43-a70f-eb731f4f29eb): created successfully Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2751850-7d18-4816-9ef7-870a3e1331d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Flow 'volume_create_manager' (b9eb9669-8ac9-4fec-b301-5c9abe50d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4f31dc04-a532-4167-b146-e59c3131b323 tempest-ServerActionsTestOtherA-521004922 None] Created volume successfully. Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Flow 'volume_create_manager' (26ef0ef0-2902-4d1c-93dc-aaf6033fd92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05da62c-6ec2-4bfd-98ec-d0b9fb9d8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05da62c-6ec2-4bfd-98ec-d0b9fb9d8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-633056942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf239e45-b81c-4b37-b149-240192808a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf0169b02f4fadabaee02ea1389473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:24Z,use_quota=True,user_id='2664cdf8e0464d6bbf805bdb1d321038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c95da81-c4b5-47d6-a3aa-390ba4769b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c95da81-c4b5-47d6-a3aa-390ba4769b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba75d440-5573-4792-a7f6-3ac4b1a7cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba75d440-5573-4792-a7f6-3ac4b1a7cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf239e45-b81c-4b37-b149-240192808a2a', 'volume_name': 'volume-cf239e45-b81c-4b37-b149-240192808a2a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04750742-04f4-42c8-92c8-2b2efd16c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04750742-04f4-42c8-92c8-2b2efd16c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01defc0-f347-4188-9344-820fed585965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Volume cf239e45-b81c-4b37-b149-240192808a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf239e45-b81c-4b37-b149-240192808a2a', 'volume_size': 1} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-633056942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf239e45-b81c-4b37-b149-240192808a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='febf0169b02f4fadabaee02ea1389473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:24Z,use_quota=True,user_id='2664cdf8e0464d6bbf805bdb1d321038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Creating volume cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:24 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:24 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a 1073741824 Aug 05 15:49:24 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:25 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a 1073741824" returned: 0 in 0.697s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:25 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a Aug 05 15:49:25 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:25 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a" returned: 0 in 0.574s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01defc0-f347-4188-9344-820fed585965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf239e45-b81c-4b37-b149-240192808a2a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f738e07-5048-4eab-92ab-b45ccad4e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:25 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Volume volume-cf239e45-b81c-4b37-b149-240192808a2a (cf239e45-b81c-4b37-b149-240192808a2a): created successfully Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f738e07-5048-4eab-92ab-b45ccad4e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Flow 'volume_create_manager' (26ef0ef0-2902-4d1c-93dc-aaf6033fd92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8207840e-fd4f-41ad-948c-13c59b356ea3 tempest-SnapshotMetadataTestJSON-912786871 None] Created volume successfully. Aug 05 15:49:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Creating offline snapshot d306156b-7cdb-48cb-aaa9-d2245c218ac5 of volume cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:49:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8a89f-d6e3-4577-abe6-9c117a0286d4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:27 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a Aug 05 15:49:27 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:27 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a" returned: 0 in 0.673s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:27 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 1G Aug 05 15:49:27 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:28 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 1G" returned: 0 in 0.724s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf239e45-b81c-4b37-b149-240192808a2a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:28 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf239e45-b81c-4b37-b149-240192808a2a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 Aug 05 15:49:28 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:28 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf239e45-b81c-4b37-b149-240192808a2a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5" returned: 0 in 0.449s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:28 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 is being set with open permissions: ugo+rw Aug 05 15:49:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:28 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 Aug 05 15:49:28 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:29 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5" returned: 0 in 0.328s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:29 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info Aug 05 15:49:29 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:29 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info" returned: 0 in 0.371s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:29 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info is being set with open permissions: ugo+rw Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:29 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info Aug 05 15:49:29 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:29 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.info" returned: 0 in 0.319s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.843s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c0fbe8b6-81b4-424b-a278-fa5a36e6dfad tempest-SnapshotMetadataTestJSON-912786871 None] Create snapshot completed successfully Aug 05 15:49:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[617de1ab-944f-4604-8cf0-3cfda7ac6930]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:30 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:30 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:30 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 0.636s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:30 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:49:30 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:31 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 1 in 0.610s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.329s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "cinder-d306156b-7cdb-48cb-aaa9-d2245c218ac5-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2834f276-daa4-4b1e-877b-3f5dde5d9a7b', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-d306156b-7cdb-48cb-aaa9-d2245c218ac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "cinder-quobyte-d306156b-7cdb-48cb-aaa9-d2245c218ac5" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-d306156b-7cdb-48cb-aaa9-d2245c218ac5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Deleting offline snapshot d306156b-7cdb-48cb-aaa9-d2245c218ac5 of volume cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] snapshot_file for this snap is: volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c913bb-3b13-4731-9ce3-271be3fba47e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-74043f98-cef2-43e4-a113-fe7cc202ce72 req-da9bc35c-fcbb-41b7-a5db-3813da4b63f4 tempest-ServerActionsTestOtherA-521004922 None] attachment_update completed successfully. Aug 05 15:49:31 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 Aug 05 15:49:31 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:32 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5" returned: 0 in 0.715s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf239e45-b81c-4b37-b149-240192808a2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e0c5c-c178-41c4-9b3f-badb8ca7b35c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:32 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a Aug 05 15:49:32 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:32 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a" returned: 0 in 0.612s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:32 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 Aug 05 15:49:32 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:33 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5" returned: 0 in 0.472s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:33 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5 Aug 05 15:49:33 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:33 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a.d306156b-7cdb-48cb-aaa9-d2245c218ac5" returned: 0 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-d306156b-7cdb-48cb-aaa9-d2245c218ac5" released by "_delete_snapshot" :: held 2.389s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" released by "delete_snapshot" :: held 2.441s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:33 devstack cinder-volume[88715]: WARNING cinder.quota [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Created reservations ['4b53a8a3-c1f9-42ed-8de5-0b2bfe12c4ae', '72d8475b-7d51-4531-9958-af0f04c4eb9f', 'b403e0de-7976-4e53-bc80-9482c8f3e485', '278e8987-2fbb-4fea-886e-203fe9b7b070'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Delete snapshot completed successfully. Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-09546cef-7944-4ebe-a733-9cd32a17af68 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-d306156b-7cdb-48cb-aaa9-d2245c218ac5-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "cinder-cf239e45-b81c-4b37-b149-240192808a2a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-cf239e45-b81c-4b37-b149-240192808a2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[27479957-44e7-48b4-9c6c-5636c151d0ea]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:35 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a Aug 05 15:49:35 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:35 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a" returned: 0 in 0.646s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:35 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a Aug 05 15:49:35 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:36 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cf239e45-b81c-4b37-b149-240192808a2a" returned: 0 in 0.705s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-quobyte-cf239e45-b81c-4b37-b149-240192808a2a" released by "delete_volume" :: held 1.473s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Created reservations ['cc29424f-a815-4785-8b31-af49d3516a13', '8d8f3700-7aa2-49ed-ab9d-7a80251b4f1a', 'c9b0abf0-605b-40de-88cb-a4d73886e263', 'bc789b80-a640-472d-8367-7b0d1620e4f8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:36 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:49:36 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:36 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:36 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Deleted volume successfully. Aug 05 15:49:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42b2c8dd-c4b3-4225-a360-18cd5f4387e4 tempest-SnapshotMetadataTestJSON-912786871 None] Lock "cinder-cf239e45-b81c-4b37-b149-240192808a2a-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:44 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=74,cinder:UPDATE=79,cinder:INSERT=23,cinder:DELETE=3 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:49:44 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=71,cinder:UPDATE=78,cinder:DELETE=10,cinder:INSERT=25 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:49:44 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (c353caef-1a91-4cf5-8452-d003abfd4684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53529831-0699-4e4e-8a9a-76e8a833dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53529831-0699-4e4e-8a9a-76e8a833dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1248454832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9db2df9-857d-4b21-a9e3-947e06e273f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:45Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e3a156-3562-44da-a455-46f5c6284757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e3a156-3562-44da-a455-46f5c6284757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcbe6c0-a2ef-4b25-96ec-aec87133cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcbe6c0-a2ef-4b25-96ec-aec87133cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9db2df9-857d-4b21-a9e3-947e06e273f5', 'volume_name': 'volume-b9db2df9-857d-4b21-a9e3-947e06e273f5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f86f86d-5df9-4a40-9bcf-feebf85d0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f86f86d-5df9-4a40-9bcf-feebf85d0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c4297-8d95-4884-9cd7-ef5cd73713cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:45 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Volume b9db2df9-857d-4b21-a9e3-947e06e273f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9db2df9-857d-4b21-a9e3-947e06e273f5', 'volume_size': 1} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1248454832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9db2df9-857d-4b21-a9e3-947e06e273f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:45Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Creating volume b9db2df9-857d-4b21-a9e3-947e06e273f5 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:45 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:45 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 1073741824 Aug 05 15:49:45 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:46 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 1073741824" returned: 0 in 1.263s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:46 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 Aug 05 15:49:46 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:47 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5" returned: 0 in 0.833s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353c4297-8d95-4884-9cd7-ef5cd73713cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9db2df9-857d-4b21-a9e3-947e06e273f5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb615ed6-5d5a-4344-a015-2ea79a48969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:47 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Volume volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 (b9db2df9-857d-4b21-a9e3-947e06e273f5): created successfully Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb615ed6-5d5a-4344-a015-2ea79a48969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (c353caef-1a91-4cf5-8452-d003abfd4684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2ae16ff6-3ed4-4342-8598-63067a522cf8 tempest-AttachVolumeNegativeTest-999683015 None] Created volume successfully. Aug 05 15:49:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f07e0-03ed-401a-917d-22ec004bbfaf]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:50 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 Aug 05 15:49:50 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:51 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5" returned: 0 in 0.832s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-b9db2df9-857d-4b21-a9e3-947e06e273f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07ad8106-20dd-478a-ba7d-f4e22988e055', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:49:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-b0dac28c-dc2e-4e69-a1ab-03d5301efa11 req-57cc8700-aaf5-44ee-aafd-b1070cb41fd3 tempest-AttachVolumeNegativeTest-999683015 None] attachment_update completed successfully. Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Flow 'volume_create_manager' (8bbfdcb2-c25f-45a4-8aab-2c0deb256390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4efb351-c005-4790-a372-0bbefeeb939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4efb351-c005-4790-a372-0bbefeeb939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1533867821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4ab8c067394c08b3322330446f8eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:52Z,use_quota=True,user_id='a586566515564e6f9ce6597866539ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf184ac-dffd-4ace-915d-9703205a94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf184ac-dffd-4ace-915d-9703205a94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905f8446-1d4e-4502-8972-4515556d8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905f8446-1d4e-4502-8972-4515556d8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'volume_name': 'volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0438b0-ef08-4af3-9442-ededb56fa41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0438b0-ef08-4af3-9442-ededb56fa41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f04ab2-8f39-4f31-9e3f-00c907135bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Volume dc197ebf-2e7a-47a7-95ea-a0e4d37a870a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'volume_size': 1} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1533867821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4ab8c067394c08b3322330446f8eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:52Z,use_quota=True,user_id='a586566515564e6f9ce6597866539ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Creating volume dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:49:53 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:49:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:53 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a 1073741824 Aug 05 15:49:53 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:54 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a 1073741824" returned: 0 in 1.056s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:54 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:49:54 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:54 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f04ab2-8f39-4f31-9e3f-00c907135bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6207f9-d990-47c6-9cde-85a2300051a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Volume volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a (dc197ebf-2e7a-47a7-95ea-a0e4d37a870a): created successfully Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6207f9-d990-47c6-9cde-85a2300051a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Flow 'volume_create_manager' (8bbfdcb2-c25f-45a4-8aab-2c0deb256390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cf6ea0ab-de2c-4aee-8be5-d973eae5ccd0 tempest-VolumesCloneTest-398638523 None] Created volume successfully. Aug 05 15:49:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e4d15724-16b3-4401-a9c9-09a7a35acb32 tempest-ServerActionsTestOtherA-521004922 None] Terminate volume connection completed successfully. Aug 05 15:49:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e4d15724-16b3-4401-a9c9-09a7a35acb32 tempest-ServerActionsTestOtherA-521004922 None] Deleting attachment 2834f276-daa4-4b1e-877b-3f5dde5d9a7b. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Flow 'volume_create_manager' (95f584cb-3f78-4da8-9ecd-e36068fa5595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc772520-1b74-4c2f-9cbb-2db93dbec02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc772520-1b74-4c2f-9cbb-2db93dbec02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2047266315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f037ee0a-62e3-4efa-9fd5-80a5bc6011f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4ab8c067394c08b3322330446f8eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:56Z,use_quota=True,user_id='a586566515564e6f9ce6597866539ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8382c0ed-16c4-4fcc-9d3f-db2289a38816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8382c0ed-16c4-4fcc-9d3f-db2289a38816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfe0f2-d2ce-4a51-804a-eed9069f6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfe0f2-d2ce-4a51-804a-eed9069f6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f037ee0a-62e3-4efa-9fd5-80a5bc6011f3', 'volume_name': 'volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3', 'volume_size': 2, 'source_volid': 'dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'source_volstatus': 'available'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31694cd-e802-4041-9dd6-3c4bd5a1d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31694cd-e802-4041-9dd6-3c4bd5a1d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484b52c-ad0a-43d1-9dc5-401219ddadec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Volume f037ee0a-62e3-4efa-9fd5-80a5bc6011f3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3', 'volume_size': 2, 'source_volid': 'dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'source_volstatus': 'available'} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Cloning volume dc197ebf-2e7a-47a7-95ea-a0e4d37a870a to volume f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Creating offline snapshot 44ba457a-db53-4881-b1a5-449f342b7718 of volume dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad33f63-dd4b-4463-93fe-9aa55c1a033d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:57 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:49:57 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:57 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 1.126s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:58 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 1G Aug 05 15:49:58 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:58 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 1G" returned: 0 in 0.913s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:58 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:49:58 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:59 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.608s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:59 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 is being set with open permissions: ugo+rw Aug 05 15:49:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:59 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:49:59 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:59 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.493s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:00 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info Aug 05 15:50:00 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:00 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info" returned: 0 in 0.625s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:00 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info is being set with open permissions: ugo+rw Aug 05 15:50:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:00 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info Aug 05 15:50:00 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:01 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.info" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] snapshot: 44ba457a-db53-4881-b1a5-449f342b7718, volume: f037ee0a-62e3-4efa-9fd5-80a5bc6011f3, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e63bc-7124-4c84-893a-c3ed9500cf9d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:01 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:50:01 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:01 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.777s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadda87a-be98-472d-903a-467c8578bc9a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:02 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:50:02 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:02 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 0.872s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:02 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:50:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:02 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 Aug 05 15:50:02 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:03 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:03 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:05 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 1.589s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:05 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:05 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:50:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:50:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:50:10 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:50:10 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=9,cinder:INSERT=2,cinder:SELECT=16 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:50:12 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" returned: 0 in 9.210s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dd1535-6706-4101-b362-b3042fee9c28]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:12 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:50:12 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:12 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 0.759s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:50:12 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Converted 1024.00 MB image at 111.18 MB/s Aug 05 15:50:12 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 is being set with open permissions: ugo+rw Aug 05 15:50:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:12 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 Aug 05 15:50:12 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:13 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" returned: 0 in 0.434s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" released by "_copy_volume_from_snapshot" :: held 12.250s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-quobyte-44ba457a-db53-4881-b1a5-449f342b7718" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-44ba457a-db53-4881-b1a5-449f342b7718" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Deleting offline snapshot 44ba457a-db53-4881-b1a5-449f342b7718 of volume dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] snapshot_file for this snap is: volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a06be-58b0-4eef-b56a-4b4c0a2673f1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:13 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:50:13 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:14 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.666s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:50:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[507683af-bf43-4d40-9bf6-d74c590e1497]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:14 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:50:14 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:15 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 0.873s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:15 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:50:15 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Flow 'volume_create_manager' (ac43d08d-5a0e-4e5d-88f6-30d4966cc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08858342-451e-4588-8a61-556091097979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08858342-451e-4588-8a61-556091097979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-148830514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4755d4e-199b-4b5f-9aaa-578ffa6b6c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c865bea06c84c61aeb4a4dfb7c04152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:15Z,use_quota=True,user_id='bc41597240064d1193e7b3b994d50600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8fd309-1634-4af9-b4ab-8d66fe455a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8fd309-1634-4af9-b4ab-8d66fe455a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fd0f3d-2ec1-4771-8188-c2d6295b1c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fd0f3d-2ec1-4771-8188-c2d6295b1c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4755d4e-199b-4b5f-9aaa-578ffa6b6c59', 'volume_name': 'volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bb69d7-e57d-4136-a17a-39c4a4262527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bb69d7-e57d-4136-a17a-39c4a4262527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b851962d-de30-4dd8-9de8-6e25ee3c812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Volume e4755d4e-199b-4b5f-9aaa-578ffa6b6c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59', 'volume_size': 1} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:15 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.670s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:15 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718 Aug 05 15:50:15 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:16 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a.44ba457a-db53-4881-b1a5-449f342b7718" returned: 0 in 0.348s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-44ba457a-db53-4881-b1a5-449f342b7718" released by "_delete_snapshot" :: held 2.763s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.582s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.616s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484b52c-ad0a-43d1-9dc5-401219ddadec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3', 'volume_size': 2, 'source_volid': 'dc197ebf-2e7a-47a7-95ea-a0e4d37a870a', 'source_volstatus': 'available'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1e764-5dc7-43ef-a92c-ec52bf3cba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[915005ce-c172-4e71-9e38-7ce42d1f49e9]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Volume volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 (f037ee0a-62e3-4efa-9fd5-80a5bc6011f3): created successfully Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d1e764-5dc7-43ef-a92c-ec52bf3cba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Flow 'volume_create_manager' (95f584cb-3f78-4da8-9ecd-e36068fa5595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bbd983bf-6ce8-4845-87ba-835d211206e5 tempest-VolumesCloneTest-398638523 None] Created volume successfully. Aug 05 15:50:16 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:50:16 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:16 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 0.415s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:16 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:50:16 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 1 in 0.986s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:50:17 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.468s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.281s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-148830514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4755d4e-199b-4b5f-9aaa-578ffa6b6c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c865bea06c84c61aeb4a4dfb7c04152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:15Z,use_quota=True,user_id='bc41597240064d1193e7b3b994d50600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Creating volume e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:50:17 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:17 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 1073741824 Aug 05 15:50:17 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8850e1bd-1122-4a14-bf0a-9fa4862101f3', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:50:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "cinder-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-26d01f13-4e60-4d52-bb85-479b845f932d req-e74005d0-fef1-4533-8b3d-f48173e43ec5 tempest-ServerActionsTestOtherA-521004922 None] attachment_update completed successfully. Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d32e1-351c-43a4-8681-6c1bd6944397]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:18 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 Aug 05 15:50:18 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:18 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 1073741824" returned: 0 in 0.991s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:18 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 Aug 05 15:50:18 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:19 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" returned: 0 in 1.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:19 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3 Aug 05 15:50:19 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:20 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" returned: 0 in 1.269s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b851962d-de30-4dd8-9de8-6e25ee3c812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5c0c1-1df3-48ae-b81e-1f471b63265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Volume volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 (e4755d4e-199b-4b5f-9aaa-578ffa6b6c59): created successfully Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5c0c1-1df3-48ae-b81e-1f471b63265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Flow 'volume_create_manager' (ac43d08d-5a0e-4e5d-88f6-30d4966cc23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-858188a5-5600-4d1e-a636-3dee2caee0e3 tempest-ServerRescueNegativeTestJSON-1670671420 None] Created volume successfully. Aug 05 15:50:20 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" returned: 0 in 1.066s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3" released by "delete_volume" :: held 2.560s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Created reservations ['7003e04c-0fbd-4d98-b2fe-ba2e5e80b798', 'c83ccb41-52c7-45d7-850c-109378b2b683', '187bf96f-b454-42d3-bad6-9da411ba85d4', '469bbd5f-2454-4f11-8744-0cacdce7dfba'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:20 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:20 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:21 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.911s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Deleted volume successfully. Aug 05 15:50:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "cinder-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a-delete_volume" acquired by "delete_volume" :: waited 0.142s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c5db92a4-6314-447e-9c71-ddf602cdca50 tempest-VolumesCloneTest-398638523 None] Lock "cinder-f037ee0a-62e3-4efa-9fd5-80a5bc6011f3-delete_volume" released by "delete_volume" :: held 4.141s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Acquiring lock "cinder-quobyte-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" acquired by "delete_volume" :: waited 0.071s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d057a96-0ab8-4e0a-b42e-ca074a013fd4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:22 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:50:22 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:23 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 1.159s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:23 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a Aug 05 15:50:23 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:24 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" returned: 0 in 0.782s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "cinder-quobyte-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a" released by "delete_volume" :: held 2.130s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:24 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Created reservations ['0b35496f-88df-4881-af1b-23028020599e', '608a2450-b5a8-4d3b-b707-d6c819726428', '6b5f7217-2d09-4dc5-85a4-6a5f4d94d326', '807de28a-6e92-4121-b208-e17bb7a3ab2b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:25 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:25 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:25 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.596s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Deleted volume successfully. Aug 05 15:50:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1b6b2fdc-c16c-4674-9c5c-4387cd810da1 tempest-VolumesCloneTest-398638523 None] Lock "cinder-dc197ebf-2e7a-47a7-95ea-a0e4d37a870a-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-843f6dd3-8123-4dd0-92d5-214b2b93c56c tempest-ServerActionsTestOtherA-521004922 None] Terminate volume connection completed successfully. Aug 05 15:50:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-843f6dd3-8123-4dd0-92d5-214b2b93c56c tempest-ServerActionsTestOtherA-521004922 None] Deleting attachment 8850e1bd-1122-4a14-bf0a-9fa4862101f3. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:50:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "cinder-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "cinder-quobyte-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-quobyte-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" acquired by "delete_volume" :: waited 0.048s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf0ff0-0cd1-4bf1-8595-34990eec5e4b]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:31 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:50:31 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:32 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 1.179s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:32 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:50:32 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:32 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 1 in 0.622s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:50:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:32 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb Aug 05 15:50:32 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (2f6fd533-2cec-4bcf-b3e6-f7dcba12212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7117b56-7183-4359-80fb-c2a98e555c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7117b56-7183-4359-80fb-c2a98e555c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1689596989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932bc165-772a-4cde-8602-c763d2700b8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:33Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb25f499-7ba0-4282-b411-ca5d12d2fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:33 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb25f499-7ba0-4282-b411-ca5d12d2fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dec178-ce7b-4a09-8c68-e491c9fac159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dec178-ce7b-4a09-8c68-e491c9fac159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932bc165-772a-4cde-8602-c763d2700b8c', 'volume_name': 'volume-932bc165-772a-4cde-8602-c763d2700b8c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16deebb4-c11a-4cc1-966b-745ebff78a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16deebb4-c11a-4cc1-966b-745ebff78a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6299c0c7-83db-4bc5-b9a2-edff85c4963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Volume 932bc165-772a-4cde-8602-c763d2700b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932bc165-772a-4cde-8602-c763d2700b8c', 'volume_size': 1} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1689596989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932bc165-772a-4cde-8602-c763d2700b8c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:33Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Creating volume 932bc165-772a-4cde-8602-c763d2700b8c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:50:33 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "cinder-7dc67d31-fd17-4a22-bcdb-7540a716318a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" returned: 0 in 0.651s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:33 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c 1073741824 Aug 05 15:50:33 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-quobyte-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb" released by "delete_volume" :: held 2.610s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-7dc67d31-fd17-4a22-bcdb-7540a716318a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "cinder-quobyte-7dc67d31-fd17-4a22-bcdb-7540a716318a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-quobyte-7dc67d31-fd17-4a22-bcdb-7540a716318a" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.quota [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Created reservations ['2037d419-44b6-441c-8c9a-0b7e0bca74dd', 'ee07325a-37e9-49c2-8fe5-a644dcad7c0c', '10065fa7-557d-48e2-aeed-12782f7c3a04', '3e0734de-94d7-4cc0-9be5-7b5bdd38a3ab'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea8d5e-6a0b-45b2-af02-7442d283cf3c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:33 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a Aug 05 15:50:33 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:33 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:33 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:34 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.490s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.manager [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Deleted volume successfully. Aug 05 15:50:34 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a" returned: 0 in 0.692s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:34 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c 1073741824" returned: 0 in 0.966s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:34 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a Aug 05 15:50:34 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-155261a1-db57-4eb2-908d-42eb1eb34046 req-af83da2d-6a64-467f-b5a1-dabfbdee4eef tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-3cf91c91-a5eb-4a43-a70f-eb731f4f29eb-delete_volume" released by "delete_volume" :: held 3.692s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:34 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c Aug 05 15:50:34 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:34 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7dc67d31-fd17-4a22-bcdb-7540a716318a" returned: 0 in 0.464s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-quobyte-7dc67d31-fd17-4a22-bcdb-7540a716318a" released by "delete_volume" :: held 1.231s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:34 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c" returned: 0 in 0.383s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6299c0c7-83db-4bc5-b9a2-edff85c4963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932bc165-772a-4cde-8602-c763d2700b8c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d0b803-8528-4fec-900c-a50d1ccb9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Volume volume-932bc165-772a-4cde-8602-c763d2700b8c (932bc165-772a-4cde-8602-c763d2700b8c): created successfully Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d0b803-8528-4fec-900c-a50d1ccb9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (2f6fd533-2cec-4bcf-b3e6-f7dcba12212a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c878b7c5-032d-4c42-b064-a7e300116e82 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:50:34 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Created reservations ['a7820f18-06c9-4c22-b876-c3951f117e16', '7793d47d-a682-4989-9ca4-1d61ca0b83b7', 'ab9e4bc5-61ce-40c2-b58b-fa2518f56eab', '5791fe1a-5ac1-4d30-84d1-3489f495c458'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:35 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:35 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:35 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Deleted volume successfully. Aug 05 15:50:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-54732d40-5fb2-449a-a3c4-2eb057851a43 tempest-ServerActionsTestOtherA-521004922 None] Lock "cinder-7dc67d31-fd17-4a22-bcdb-7540a716318a-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (408c4fc6-5038-4b84-98e2-8203ed2c0287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13e161c-cf23-40d9-8ea2-5fbd18bb0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13e161c-cf23-40d9-8ea2-5fbd18bb0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-696474735',display_name='tempest-VolumesGetTest-Volume-722247635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fd1be4-9cc7-40a3-a848-3983beb0f75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:37Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5888ee45-70ee-4a63-9508-8cd21ba199d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5888ee45-70ee-4a63-9508-8cd21ba199d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97abbe27-49c3-4264-9fcd-df58ea909cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97abbe27-49c3-4264-9fcd-df58ea909cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fd1be4-9cc7-40a3-a848-3983beb0f75d', 'volume_name': 'volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bc6b97-2a06-4fc2-9b8f-9b42b7c176e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bc6b97-2a06-4fc2-9b8f-9b42b7c176e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8283c13-9ad3-4d1b-9854-86f1a71f71f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:36 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Volume 26fd1be4-9cc7-40a3-a848-3983beb0f75d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d', 'volume_size': 1} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-696474735',display_name='tempest-VolumesGetTest-Volume-722247635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fd1be4-9cc7-40a3-a848-3983beb0f75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:37Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Creating volume 26fd1be4-9cc7-40a3-a848-3983beb0f75d {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:50:36 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:50:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:36 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d 1073741824 Aug 05 15:50:36 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:37 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d 1073741824" returned: 0 in 0.863s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:37 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d Aug 05 15:50:37 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Acquiring lock "cinder-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "cinder-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Acquiring lock "cinder-quobyte-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "cinder-quobyte-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" acquired by "delete_volume" :: waited 0.041s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7178ae-8136-4216-a802-a2cc8df89473]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:38 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d" returned: 0 in 0.647s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8283c13-9ad3-4d1b-9854-86f1a71f71f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b828676a-468b-4a68-96ba-611bb16040aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:38 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Volume volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d (26fd1be4-9cc7-40a3-a848-3983beb0f75d): created successfully Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b828676a-468b-4a68-96ba-611bb16040aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (408c4fc6-5038-4b84-98e2-8203ed2c0287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:38 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 Aug 05 15:50:38 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5a569693-0f0d-4891-a9a8-c63b574592a1 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-26fd1be4-9cc7-40a3-a848-3983beb0f75d-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:39 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" returned: 0 in 0.717s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "cinder-26fd1be4-9cc7-40a3-a848-3983beb0f75d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:39 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59 Aug 05 15:50:39 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-26fd1be4-9cc7-40a3-a848-3983beb0f75d" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-26fd1be4-9cc7-40a3-a848-3983beb0f75d" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3c9cd6-7aab-4f7c-9f7b-6dd13f9ab110]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:39 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d Aug 05 15:50:39 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:39 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" returned: 0 in 0.554s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "cinder-quobyte-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59" released by "delete_volume" :: held 1.357s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Created reservations ['ccff38ec-3174-40c0-97c8-046c68791134', '7e5c50f0-0fb2-4202-bb7c-b84817eca6cb', 'be608cbe-ef8c-4310-a5c9-50aba448ff96', '86c31c32-2ef6-420e-9bc2-751d87f6c811'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:39 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:39 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:40 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d" returned: 0 in 0.799s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:40 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d Aug 05 15:50:40 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:40 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.541s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Deleted volume successfully. Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2c6c82b-b81c-43bc-915e-15da2da6ce55 tempest-ServerRescueNegativeTestJSON-1670671420 None] Lock "cinder-e4755d4e-199b-4b5f-9aaa-578ffa6b6c59-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:40 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-26fd1be4-9cc7-40a3-a848-3983beb0f75d" returned: 0 in 0.599s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-26fd1be4-9cc7-40a3-a848-3983beb0f75d" released by "delete_volume" :: held 1.509s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Created reservations ['52643c8c-3d11-4f0f-95fd-eac8518773ad', '6b63fd4e-c595-4cc9-9516-2edfbd7a09dc', 'b9b1bf45-bf63-49a5-b7a2-33fe0f3b777d', '9d0dc0ea-ab61-47cf-8222-9004f0c8cb48'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:40 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:40 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:41 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.506s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dd30cd0b-4ef0-4b46-bfae-547595b87f19 tempest-VolumesGetTest-1830830395 None] Lock "cinder-26fd1be4-9cc7-40a3-a848-3983beb0f75d-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-932bc165-772a-4cde-8602-c763d2700b8c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-932bc165-772a-4cde-8602-c763d2700b8c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-932bc165-772a-4cde-8602-c763d2700b8c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-932bc165-772a-4cde-8602-c763d2700b8c" acquired by "delete_volume" :: waited 0.054s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a33653-5420-4ad8-8538-c73c7218011c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:42 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c Aug 05 15:50:42 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:42 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c" returned: 0 in 0.843s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:42 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c Aug 05 15:50:42 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:43 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-932bc165-772a-4cde-8602-c763d2700b8c" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-932bc165-772a-4cde-8602-c763d2700b8c" released by "delete_volume" :: held 1.330s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Created reservations ['59d3c5a1-f75c-4756-8dde-c63ef5ae4be9', 'cc1e4d57-a5b7-45f5-92c7-7651ba707c30', 'c29f15e9-130f-4457-a727-b3c879c4eb2e', 'e3683588-37dd-4f4a-8428-2cb0b57febb1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:43 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:50:43 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:44 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:44 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:50:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95c79ff3-00df-4149-a72b-617e8869b7f3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-932bc165-772a-4cde-8602-c763d2700b8c-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (59d6e278-44f7-4486-81da-1d594147609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f53cda3-cee3-4a04-8142-78ed5343b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f53cda3-cee3-4a04-8142-78ed5343b58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-440502116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becac619-5026-4a14-aca6-5d05e72d527a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:45Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d364613-5e66-4b14-8c8f-832898065e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d364613-5e66-4b14-8c8f-832898065e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffb0cb3-7ea6-477e-a3e7-8a4ae144f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffb0cb3-7ea6-477e-a3e7-8a4ae144f86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becac619-5026-4a14-aca6-5d05e72d527a', 'volume_name': 'volume-becac619-5026-4a14-aca6-5d05e72d527a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf595437-33f5-44e4-b9ee-c48cc24c6d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf595437-33f5-44e4-b9ee-c48cc24c6d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110540d-3ada-4f67-877c-e3141451c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:45 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Volume becac619-5026-4a14-aca6-5d05e72d527a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becac619-5026-4a14-aca6-5d05e72d527a', 'volume_size': 1} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-440502116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becac619-5026-4a14-aca6-5d05e72d527a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:45Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Creating volume becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:50:45 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:50:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:45 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a 1073741824 Aug 05 15:50:45 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:46 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a 1073741824" returned: 0 in 0.970s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:46 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:50:46 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:46 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110540d-3ada-4f67-877c-e3141451c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becac619-5026-4a14-aca6-5d05e72d527a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cf70ef-c73f-4fc3-8b79-e9754b466ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:46 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Volume volume-becac619-5026-4a14-aca6-5d05e72d527a (becac619-5026-4a14-aca6-5d05e72d527a): created successfully Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cf70ef-c73f-4fc3-8b79-e9754b466ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (59d6e278-44f7-4486-81da-1d594147609c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e20772b5-0a55-4294-919c-35bcd73cb63e tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (80f910a9-b9c2-4802-a3b5-81c4841e6b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5e507f-1fec-4cc2-9c23-13b70732fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5e507f-1fec-4cc2-9c23-13b70732fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1796945075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c569b1-597e-4100-bc56-284ba18835a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=becac619-5026-4a14-aca6-5d05e72d527a,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:48Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f1b3f-957e-43a9-a1ba-418145fa806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f1b3f-957e-43a9-a1ba-418145fa806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05501676-b1f0-41b2-82dc-c6bca568bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05501676-b1f0-41b2-82dc-c6bca568bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a1c569b1-597e-4100-bc56-284ba18835a5', 'volume_name': 'volume-a1c569b1-597e-4100-bc56-284ba18835a5', 'volume_size': 1, 'source_volid': 'becac619-5026-4a14-aca6-5d05e72d527a', 'source_volstatus': 'available'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dceae9-494d-452f-a73c-7f0726046b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dceae9-494d-452f-a73c-7f0726046b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40ba7e5-7d05-4c2f-be0f-559c9d68eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Volume a1c569b1-597e-4100-bc56-284ba18835a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a1c569b1-597e-4100-bc56-284ba18835a5', 'volume_size': 1, 'source_volid': 'becac619-5026-4a14-aca6-5d05e72d527a', 'source_volstatus': 'available'} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:48 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Cloning volume becac619-5026-4a14-aca6-5d05e72d527a to volume a1c569b1-597e-4100-bc56-284ba18835a5 Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Creating offline snapshot 53fd5a3a-acae-413d-9369-5fe3739f0da4 of volume becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922f398-7f27-40a1-862d-0986fbc7c5c7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:48 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:50:48 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:48 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:48 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 1G Aug 05 15:50:48 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:49 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 1G" returned: 0 in 0.705s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becac619-5026-4a14-aca6-5d05e72d527a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:49 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becac619-5026-4a14-aca6-5d05e72d527a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:50:49 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:49 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becac619-5026-4a14-aca6-5d05e72d527a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:49 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 is being set with open permissions: ugo+rw Aug 05 15:50:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:49 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:50:49 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:50 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.423s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:50 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info Aug 05 15:50:50 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:50 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info" returned: 0 in 0.335s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:50 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info is being set with open permissions: ugo+rw Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:50 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info Aug 05 15:50:50 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:50 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.info" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] snapshot: 53fd5a3a-acae-413d-9369-5fe3739f0da4, volume: a1c569b1-597e-4100-bc56-284ba18835a5, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:50:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeaa0db-f4ac-4714-b0f3-0fb289687776]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:51 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:50:51 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:51 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.596s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-becac619-5026-4a14-aca6-5d05e72d527a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43c329-208b-478d-9630-970ec8d99182]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:51 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:50:51 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:52 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.491s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:52 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:50:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:52 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 Aug 05 15:50:52 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-c730febd-afa8-405f-b2e3-19c4cafda385 req-48c9c73b-35b7-4936-9ac1-794729e6a3fd tempest-AttachVolumeNegativeTest-999683015 None] Terminate volume connection completed successfully. Aug 05 15:50:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-c730febd-afa8-405f-b2e3-19c4cafda385 req-48c9c73b-35b7-4936-9ac1-794729e6a3fd tempest-AttachVolumeNegativeTest-999683015 None] Deleting attachment 07ad8106-20dd-478a-ba7d-f4e22988e055. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:50:58 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5" returned: 0 in 6.202s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b284c4f-9950-4579-8ee9-7d25bccd6da9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:58 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:50:58 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:58 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.637s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:50:58 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Converted 1024.00 MB image at 165.07 MB/s Aug 05 15:50:58 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 is being set with open permissions: ugo+rw Aug 05 15:50:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:59 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 Aug 05 15:50:59 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:59 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" released by "_copy_volume_from_snapshot" :: held 8.346s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-53fd5a3a-acae-413d-9369-5fe3739f0da4" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-53fd5a3a-acae-413d-9369-5fe3739f0da4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Deleting offline snapshot 53fd5a3a-acae-413d-9369-5fe3739f0da4 of volume becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] snapshot_file for this snap is: volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9df302-20f4-4168-9ccf-df63225ead4e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:59 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:50:59 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:59 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.515s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-becac619-5026-4a14-aca6-5d05e72d527a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[32970fca-c01d-462f-b04d-9cb844027d73]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:00 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:51:00 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:00 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.485s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:00 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:51:00 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:00 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.396s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:00 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4 Aug 05 15:51:00 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:01 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a.53fd5a3a-acae-413d-9369-5fe3739f0da4" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-53fd5a3a-acae-413d-9369-5fe3739f0da4" released by "_delete_snapshot" :: held 1.852s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40ba7e5-7d05-4c2f-be0f-559c9d68eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c569b1-597e-4100-bc56-284ba18835a5', 'volume_size': 1, 'source_volid': 'becac619-5026-4a14-aca6-5d05e72d527a', 'source_volstatus': 'available'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5807770b-e36c-4d36-b215-86cf1586e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Volume volume-a1c569b1-597e-4100-bc56-284ba18835a5 (a1c569b1-597e-4100-bc56-284ba18835a5): created successfully Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5807770b-e36c-4d36-b215-86cf1586e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (80f910a9-b9c2-4802-a3b5-81c4841e6b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-02d79fe8-4fd4-4e84-8d0c-c00f949745a9 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (04bd322c-4f19-4d5f-9a77-c241a3ef101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb914f96-50fc-427b-8c27-20e456f16f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb914f96-50fc-427b-8c27-20e456f16f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-250371135',display_name='tempest-VolumesGetTest-Volume-78520226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa03444-49ae-49fe-967b-dacfbe0b39ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:03Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0240bb74-65e4-4c38-a310-5f6cce337c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0240bb74-65e4-4c38-a310-5f6cce337c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87809e0f-f03b-4396-ada5-fc9ecdbaa8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87809e0f-f03b-4396-ada5-fc9ecdbaa8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa03444-49ae-49fe-967b-dacfbe0b39ac', 'volume_name': 'volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b98e701-baa6-432a-9164-49189584a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b98e701-baa6-432a-9164-49189584a86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d0dfa3-35b6-4bd8-a4ad-2f09dbe46ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Volume bfa03444-49ae-49fe-967b-dacfbe0b39ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac', 'volume_size': 1} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-250371135',display_name='tempest-VolumesGetTest-Volume-78520226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa03444-49ae-49fe-967b-dacfbe0b39ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:03Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Creating volume bfa03444-49ae-49fe-967b-dacfbe0b39ac {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:02 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:02 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac 1073741824 Aug 05 15:51:02 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac 1073741824" returned: 0 in 0.515s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:03 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac Aug 05 15:51:03 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac" returned: 0 in 0.305s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d0dfa3-35b6-4bd8-a4ad-2f09dbe46ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:03 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:03 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d23a99d-64d7-4557-9aeb-dcad745523bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:03 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Volume volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac (bfa03444-49ae-49fe-967b-dacfbe0b39ac): created successfully Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d23a99d-64d7-4557-9aeb-dcad745523bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (04bd322c-4f19-4d5f-9a77-c241a3ef101d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3f7b0fe2-d84e-4738-92f3-2c1a5542f9e4 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:51:04 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.323s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-bfa03444-49ae-49fe-967b-dacfbe0b39ac-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-bfa03444-49ae-49fe-967b-dacfbe0b39ac-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-bfa03444-49ae-49fe-967b-dacfbe0b39ac" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-bfa03444-49ae-49fe-967b-dacfbe0b39ac" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b72692f-40e7-40e1-b7a5-368c8dfafc2a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:05 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac Aug 05 15:51:05 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:05 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac" returned: 0 in 0.439s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:05 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac Aug 05 15:51:05 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:05 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bfa03444-49ae-49fe-967b-dacfbe0b39ac" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-bfa03444-49ae-49fe-967b-dacfbe0b39ac" released by "delete_volume" :: held 0.772s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Created reservations ['0878140f-bc81-404f-85f8-339b549725ab', 'a3c3b944-9920-43d5-b7df-828922214891', 'ed901a3c-f013-42ac-b87c-eb08444beaba', 'f9a08d57-8686-490c-b18a-b4c8e63844f4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:06 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:06 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-a1c569b1-597e-4100-bc56-284ba18835a5-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-a1c569b1-597e-4100-bc56-284ba18835a5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:06 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" acquired by "delete_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac92787b-3041-4d8e-8ae0-7d55ba6765be]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3a75a53-5e4e-4906-aac1-86e3967971f9 tempest-VolumesGetTest-1830830395 None] Lock "cinder-bfa03444-49ae-49fe-967b-dacfbe0b39ac-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:06 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 Aug 05 15:51:06 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:06 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:06 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5 Aug 05 15:51:06 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:07 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a1c569b1-597e-4100-bc56-284ba18835a5" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-a1c569b1-597e-4100-bc56-284ba18835a5" released by "delete_volume" :: held 0.786s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Created reservations ['722ad43e-469c-46d9-8082-3955dc3a5e6c', '4251aa9b-ab96-41aa-9fdf-15623113c97d', 'd4491f6f-b84b-465b-9930-1ea9e36d6600', '1d82cac7-1d16-4f9c-9e5a-ab140db6d99e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:07 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:07 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-becac619-5026-4a14-aca6-5d05e72d527a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "cinder-becac619-5026-4a14-aca6-5d05e72d527a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-becac619-5026-4a14-aca6-5d05e72d527a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-becac619-5026-4a14-aca6-5d05e72d527a" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8df697-6594-44c3-afb8-ac76f359be66]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:07 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.471s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:51:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-28007385-d9f9-491e-8eed-974d178f7da3 tempest-VolumesGetTest-1830830395 None] Lock "cinder-a1c569b1-597e-4100-bc56-284ba18835a5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:07 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:51:07 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:08 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:08 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a Aug 05 15:51:08 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:08 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-becac619-5026-4a14-aca6-5d05e72d527a" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-becac619-5026-4a14-aca6-5d05e72d527a" released by "delete_volume" :: held 0.819s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Created reservations ['defe8eed-7bd8-43fd-a357-85fc475bbc9a', 'b283b259-9346-4f1d-aebd-eea1e36e1347', 'a361df57-8b3a-46f4-ad09-e7e0d289a56a', '23b615a5-13a4-4555-ae63-4854663e8559'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:08 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:08 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:09 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2570b513-f662-4d79-a9d2-b694836fcc3e tempest-VolumesGetTest-1830830395 None] Lock "cinder-becac619-5026-4a14-aca6-5d05e72d527a-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (cab8709b-e6b4-4758-a129-fc204903ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e853f5eb-936a-467a-b0ac-605d2d04603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e853f5eb-936a-467a-b0ac-605d2d04603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-16729297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef08cef6-b88f-4dc8-bf13-f197765f0658,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:10Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af1e66e-1991-4f38-ab41-dd99a7f139f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af1e66e-1991-4f38-ab41-dd99a7f139f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb1d5e8-8c91-44c1-9950-8354e590cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:09 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb1d5e8-8c91-44c1-9950-8354e590cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef08cef6-b88f-4dc8-bf13-f197765f0658', 'volume_name': 'volume-ef08cef6-b88f-4dc8-bf13-f197765f0658', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfac4ab3-460e-4fd1-bb95-4411f399f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfac4ab3-460e-4fd1-bb95-4411f399f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0a6b68-7abe-4f65-8bd4-b39068ae5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:10 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Volume ef08cef6-b88f-4dc8-bf13-f197765f0658: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef08cef6-b88f-4dc8-bf13-f197765f0658', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Trying to clone ef08cef6-b88f-4dc8-bf13-f197765f0658 from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:51:10 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5de60-f1f4-49eb-baf9-6dcfe51c02dd]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:10 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD Aug 05 15:51:10 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:11 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad is fetched for user 8d5a2caf84b4476095a970956f671283. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=99,cinder:SELECT=67,cinder:INSERT=24,cinder:DELETE=9 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=111,cinder:SELECT=82,cinder:INSERT=25,cinder:DELETE=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b2858-9eac-4991-bda5-c3edecdda194]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:11 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD Aug 05 15:51:11 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:11 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-16729297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef08cef6-b88f-4dc8-bf13-f197765f0658,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:10Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Creating volume ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:11 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:11 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1073741824 Aug 05 15:51:11 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:12 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1073741824" returned: 0 in 0.551s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:12 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:12 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:12 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 0 in 0.289s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Attempting download of 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume ef08cef6-b88f-4dc8-bf13-f197765f0658. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f205e-c6e2-42f8-8ce9-bfc67f32cbb5]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:12 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9 Aug 05 15:51:12 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:13 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9" returned: 0 in 0.455s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:13 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9 Aug 05 15:51:13 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:13 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9" returned: 1 in 0.393s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_2aysowi9' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0819df-8b86-4587-acc2-60d7e5aaf772]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:13 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD Aug 05 15:51:13 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:14 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:14 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:51:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:14 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:14 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:16 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 0 in 2.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:16 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_dgoggot0devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:51:16 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Converted 112.00 MB image at 46.09 MB/s Aug 05 15:51:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:16 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1G Aug 05 15:51:16 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:17 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 1G" returned: 0 in 0.481s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3536d8eb-4832-4e13-aae5-ec8879a3e016]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:17 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:17 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:17 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 0 in 0.540s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:17 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:17 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:18 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 1 in 0.461s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Downloaded image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume ef08cef6-b88f-4dc8-bf13-f197765f0658 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad for user 8d5a2caf84b4476095a970956f671283 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Marking volume ef08cef6-b88f-4dc8-bf13-f197765f0658 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Copying metadata from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad to ef08cef6-b88f-4dc8-bf13-f197765f0658. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Creating volume glance metadata for volume ef08cef6-b88f-4dc8-bf13-f197765f0658 backed by image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0a6b68-7abe-4f65-8bd4-b39068ae5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef08cef6-b88f-4dc8-bf13-f197765f0658', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531cc340-2c90-4ded-87b9-10bf5465eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:18 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Volume volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 (ef08cef6-b88f-4dc8-bf13-f197765f0658): created successfully Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531cc340-2c90-4ded-87b9-10bf5465eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (cab8709b-e6b4-4758-a129-fc204903ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f5ef5888-04d6-4881-8150-0bb5b343e6b7 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (46db6624-4328-4b65-b6b1-9e9c80b99524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbc5d12-82d5-487c-a19b-b0a1bf5aaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbc5d12-82d5-487c-a19b-b0a1bf5aaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839868207',display_name='tempest-VolumesGetTest-Volume-276610522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd504045-68a2-49b2-8106-b9bc583586fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:21Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b94374-8846-4aa7-93a6-5dbe3b75203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b94374-8846-4aa7-93a6-5dbe3b75203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9de6646-554f-4d7e-9a4a-ea96a9b34cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9de6646-554f-4d7e-9a4a-ea96a9b34cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd504045-68a2-49b2-8106-b9bc583586fb', 'volume_name': 'volume-bd504045-68a2-49b2-8106-b9bc583586fb', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d53b5-911d-4e60-a201-31520ffaa4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d53b5-911d-4e60-a201-31520ffaa4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e56c3e-c92b-4496-8499-4b53f117f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Volume bd504045-68a2-49b2-8106-b9bc583586fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd504045-68a2-49b2-8106-b9bc583586fb', 'volume_size': 1} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839868207',display_name='tempest-VolumesGetTest-Volume-276610522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd504045-68a2-49b2-8106-b9bc583586fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43dcfcd2088d41ef976b61992817f4cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:21Z,use_quota=True,user_id='8d5a2caf84b4476095a970956f671283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Creating volume bd504045-68a2-49b2-8106-b9bc583586fb {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:20 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:20 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb 1073741824 Aug 05 15:51:20 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:21 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb 1073741824" returned: 0 in 0.586s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:21 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb Aug 05 15:51:21 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:21 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb" returned: 0 in 0.366s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e56c3e-c92b-4496-8499-4b53f117f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd504045-68a2-49b2-8106-b9bc583586fb', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be705d5-cdac-4d4a-82cd-49316789f130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:21 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Volume volume-bd504045-68a2-49b2-8106-b9bc583586fb (bd504045-68a2-49b2-8106-b9bc583586fb): created successfully Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be705d5-cdac-4d4a-82cd-49316789f130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Flow 'volume_create_manager' (46db6624-4328-4b65-b6b1-9e9c80b99524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b734f055-91a0-45e3-9639-b86dbbc2fa62 tempest-VolumesGetTest-1830830395 None] Created volume successfully. Aug 05 15:51:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-bd504045-68a2-49b2-8106-b9bc583586fb-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "cinder-bd504045-68a2-49b2-8106-b9bc583586fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-bd504045-68a2-49b2-8106-b9bc583586fb" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-bd504045-68a2-49b2-8106-b9bc583586fb" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bbe1e2-8295-4e3f-90d7-811d29527657]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:23 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb Aug 05 15:51:23 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:23 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb" returned: 0 in 0.880s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:24 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb Aug 05 15:51:24 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:24 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd504045-68a2-49b2-8106-b9bc583586fb" returned: 0 in 0.560s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-bd504045-68a2-49b2-8106-b9bc583586fb" released by "delete_volume" :: held 1.530s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Created reservations ['9de5acd9-4c77-47d7-a58e-af4b9fa64f71', '77cb1a23-7b0b-42eb-9467-cbcf29cc5f80', '8f23384c-6790-43e4-83c4-7068f70da8d9', 'e949efdb-161a-4593-ac82-ea26aaac4432'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:24 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:24 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:25 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94d77b78-02e7-495d-be99-ed2b69655ed6 tempest-VolumesGetTest-1830830395 None] Lock "cinder-bd504045-68a2-49b2-8106-b9bc583586fb-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-ef08cef6-b88f-4dc8-bf13-f197765f0658-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "cinder-ef08cef6-b88f-4dc8-bf13-f197765f0658-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Acquiring lock "cinder-quobyte-ef08cef6-b88f-4dc8-bf13-f197765f0658" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-ef08cef6-b88f-4dc8-bf13-f197765f0658" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[010ea63e-0bc7-4396-b0ae-7dc7fa36760c]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:25 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:25 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:26 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 0 in 0.546s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:26 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:26 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:27 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 1 in 0.850s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:27 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658 Aug 05 15:51:27 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef08cef6-b88f-4dc8-bf13-f197765f0658" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:27 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "cinder-quobyte-ef08cef6-b88f-4dc8-bf13-f197765f0658" released by "delete_volume" :: held 2.101s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:27 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Created reservations ['26f3f932-45d6-4a7e-8f84-df6ad4d382a5', 'b4bb4f27-8607-4d85-8041-ddd451b31b28', '26062fb2-39c3-407a-b8e6-e3ed68ef775a', '72e4af6c-03ba-4ac2-8fdf-72a2ef380aca'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:28 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:28 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:28 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.646s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Deleted volume successfully. Aug 05 15:51:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4313cfb2-54c9-4612-9e13-80c7183f21c5 tempest-VolumesGetTest-1830830395 None] Lock "cinder-ef08cef6-b88f-4dc8-bf13-f197765f0658-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:38 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:INSERT=9,cinder:SELECT=21,cinder:UPDATE=24 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:38 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:INSERT=14,cinder:UPDATE=22,cinder:SELECT=18,cinder:DELETE=4 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (510e0f7a-3c6d-417e-8c0f-2bd12adcb7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cdac7-72ac-46a5-992b-f29f40746515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cdac7-72ac-46a5-992b-f29f40746515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-794873528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9715fccc-bb13-470d-9612-0067b37bd6ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:43Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c58011-a10a-4235-b0ae-b6ed19e0d26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c58011-a10a-4235-b0ae-b6ed19e0d26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bd8372-0709-4983-a429-c0f30fd5e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bd8372-0709-4983-a429-c0f30fd5e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9715fccc-bb13-470d-9612-0067b37bd6ac', 'volume_name': 'volume-9715fccc-bb13-470d-9612-0067b37bd6ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de178e83-489e-414d-a112-0b0a30064e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de178e83-489e-414d-a112-0b0a30064e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7267a8-fcc8-446d-8d38-7836c0d8dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Volume 9715fccc-bb13-470d-9612-0067b37bd6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9715fccc-bb13-470d-9612-0067b37bd6ac', 'volume_size': 1} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-794873528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9715fccc-bb13-470d-9612-0067b37bd6ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:43Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Creating volume 9715fccc-bb13-470d-9612-0067b37bd6ac {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:43 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:43 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac 1073741824 Aug 05 15:51:43 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:43 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac 1073741824" returned: 0 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:43 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac Aug 05 15:51:43 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:44 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac" returned: 0 in 0.269s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7267a8-fcc8-446d-8d38-7836c0d8dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9715fccc-bb13-470d-9612-0067b37bd6ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e89af08-77fe-4b95-8cb7-6cc33efe8512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:44 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Volume volume-9715fccc-bb13-470d-9612-0067b37bd6ac (9715fccc-bb13-470d-9612-0067b37bd6ac): created successfully Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e89af08-77fe-4b95-8cb7-6cc33efe8512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (510e0f7a-3c6d-417e-8c0f-2bd12adcb7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f4dd1911-b4b4-459b-a127-e03fab57340a tempest-VolumesListTestJSON-888251363 None] Created volume successfully. Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (ad4010fa-79c8-409d-80cd-77d8d66c00cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2aac3-53ef-4d1d-9968-fc36c985d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2aac3-53ef-4d1d-9968-fc36c985d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1524531886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31b93d2-7945-4474-8c9b-4d6bf472cb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:46Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a1a6e6-d8a4-4d7b-be19-cf72edd1b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a1a6e6-d8a4-4d7b-be19-cf72edd1b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef19065a-b5a1-46b5-a1b7-b0ccfa5354d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef19065a-b5a1-46b5-a1b7-b0ccfa5354d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31b93d2-7945-4474-8c9b-4d6bf472cb23', 'volume_name': 'volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f9b623-c841-41f7-ab9b-fd3a0ee8b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f9b623-c841-41f7-ab9b-fd3a0ee8b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4584fe6-85dd-4c35-abe4-b7491d9c67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:45 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Volume e31b93d2-7945-4474-8c9b-4d6bf472cb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23', 'volume_size': 1} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1524531886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31b93d2-7945-4474-8c9b-4d6bf472cb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:46Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Creating volume e31b93d2-7945-4474-8c9b-4d6bf472cb23 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:45 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:45 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 1073741824 Aug 05 15:51:45 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:46 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 1073741824" returned: 0 in 0.428s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:46 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 Aug 05 15:51:46 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:46 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4584fe6-85dd-4c35-abe4-b7491d9c67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d32f4f7-cd8e-4740-baef-62d10437ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:46 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Volume volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 (e31b93d2-7945-4474-8c9b-4d6bf472cb23): created successfully Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d32f4f7-cd8e-4740-baef-62d10437ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (ad4010fa-79c8-409d-80cd-77d8d66c00cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6af84375-8092-4079-8b41-1c7cd7d50494 tempest-VolumesListTestJSON-888251363 None] Created volume successfully. Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (6947b382-0367-4c22-abcc-942dde0421f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f458f277-d580-42c3-afd3-609b4f58f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f458f277-d580-42c3-afd3-609b4f58f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-920300201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b096a4-28bd-4529-b532-6790e1b91b86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:48Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c135c01-db70-4d7c-8242-99901a1cfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c135c01-db70-4d7c-8242-99901a1cfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb58edfa-ace2-49f3-8f7b-1f967c33cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb58edfa-ace2-49f3-8f7b-1f967c33cd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b096a4-28bd-4529-b532-6790e1b91b86', 'volume_name': 'volume-88b096a4-28bd-4529-b532-6790e1b91b86', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c82f8c-ddc5-4bb1-9869-e3efca6784c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c82f8c-ddc5-4bb1-9869-e3efca6784c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b49d5b-9d37-4853-aa21-78f8ecee64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Volume 88b096a4-28bd-4529-b532-6790e1b91b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b096a4-28bd-4529-b532-6790e1b91b86', 'volume_size': 1} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-920300201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b096a4-28bd-4529-b532-6790e1b91b86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f210236754274ec8b209b6bb8b19259e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:48Z,use_quota=True,user_id='581c06d795bb4ebe85b0e5df1376b911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Creating volume 88b096a4-28bd-4529-b532-6790e1b91b86 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:48 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:48 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 1073741824 Aug 05 15:51:48 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:49 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 1073741824" returned: 0 in 0.434s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:49 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 Aug 05 15:51:49 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:49 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b49d5b-9d37-4853-aa21-78f8ecee64c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b096a4-28bd-4529-b532-6790e1b91b86', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a8483-1527-45d4-8eaa-69f2f4a8540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:49 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Volume volume-88b096a4-28bd-4529-b532-6790e1b91b86 (88b096a4-28bd-4529-b532-6790e1b91b86): created successfully Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647a8483-1527-45d4-8eaa-69f2f4a8540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Flow 'volume_create_manager' (6947b382-0367-4c22-abcc-942dde0421f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-71dc8ec2-54f4-4922-ab1e-df4aff1e13cb tempest-VolumesListTestJSON-888251363 None] Created volume successfully. Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-88b096a4-28bd-4529-b532-6790e1b91b86-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-88b096a4-28bd-4529-b532-6790e1b91b86-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-quobyte-88b096a4-28bd-4529-b532-6790e1b91b86" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-88b096a4-28bd-4529-b532-6790e1b91b86" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[375457db-42eb-4586-bf76-b94d036f2fae]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:52 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 Aug 05 15:51:52 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:52 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:52 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86 Aug 05 15:51:52 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:52 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88b096a4-28bd-4529-b532-6790e1b91b86" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-88b096a4-28bd-4529-b532-6790e1b91b86" released by "delete_volume" :: held 0.676s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Created reservations ['0fab0a20-6fd4-47be-8f17-9652c5446e8a', '5d5ed3ca-fd19-42b6-a720-3f4d7f83b382', '6fbc268c-f14f-4c2c-8af6-3bf132403441', '7faffac8-63f6-4670-a3dd-014122a8b168'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:52 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:52 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:53 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Deleted volume successfully. Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8adf2a99-3cfb-44d2-ac2e-505d05ec5a9d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-88b096a4-28bd-4529-b532-6790e1b91b86-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-e31b93d2-7945-4474-8c9b-4d6bf472cb23-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-e31b93d2-7945-4474-8c9b-4d6bf472cb23-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-quobyte-e31b93d2-7945-4474-8c9b-4d6bf472cb23" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-e31b93d2-7945-4474-8c9b-4d6bf472cb23" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9c10e1-c030-466e-a334-aa229c95b3d1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:53 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 Aug 05 15:51:53 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:53 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23" returned: 0 in 0.376s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:53 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23 Aug 05 15:51:53 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:54 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e31b93d2-7945-4474-8c9b-4d6bf472cb23" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-e31b93d2-7945-4474-8c9b-4d6bf472cb23" released by "delete_volume" :: held 0.658s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Created reservations ['19e4d990-61ce-42d9-9f78-b0c3f1c564b8', '4049c1d1-434c-426d-9847-21024ab2a24a', '2056bcb7-e532-4d53-a702-9c5ce336d2af', '3e924bf0-7ebb-453f-a47d-d825a2b896a1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:54 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:54 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:54 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.239s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Deleted volume successfully. Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-21063f4e-5d75-4aa7-965e-fa7c50cabe8d tempest-VolumesListTestJSON-888251363 None] Lock "cinder-e31b93d2-7945-4474-8c9b-4d6bf472cb23-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-9715fccc-bb13-470d-9612-0067b37bd6ac-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "cinder-9715fccc-bb13-470d-9612-0067b37bd6ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Acquiring lock "cinder-quobyte-9715fccc-bb13-470d-9612-0067b37bd6ac" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-9715fccc-bb13-470d-9612-0067b37bd6ac" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603e840-0b72-4bbe-a586-2efbbe413f7c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:54 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac Aug 05 15:51:54 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:55 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:55 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac Aug 05 15:51:55 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:55 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9715fccc-bb13-470d-9612-0067b37bd6ac" returned: 0 in 0.245s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "cinder-quobyte-9715fccc-bb13-470d-9612-0067b37bd6ac" released by "delete_volume" :: held 0.670s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Created reservations ['2201345c-eb6c-4346-b6fe-a8dbadf70c99', '819da915-882f-4b69-9783-d145e8879042', '9c2caff8-e710-4583-8a63-20f625b5360b', 'c0ba4af7-6363-4f5e-9bf4-410a7753ceb0'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:55 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:51:55 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:55 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.292s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Deleted volume successfully. Aug 05 15:51:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-30c640e3-e1f5-4974-8890-2e63f46010f6 tempest-VolumesListTestJSON-888251363 None] Lock "cinder-9715fccc-bb13-470d-9612-0067b37bd6ac-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (8f7ec976-0394-4eeb-9afe-98e99db69433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3292810-a6b1-4e9c-a14e-c753529db227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3292810-a6b1-4e9c-a14e-c753529db227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1332480698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c59a4-e60a-4db4-b93b-38328b23137b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:56Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e10a90-fd41-4c72-9082-1545be4d925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e10a90-fd41-4c72-9082-1545be4d925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3375d2-e04f-40d9-948b-382423a53270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3375d2-e04f-40d9-948b-382423a53270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82c59a4-e60a-4db4-b93b-38328b23137b', 'volume_name': 'volume-e82c59a4-e60a-4db4-b93b-38328b23137b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbfb33f-a103-4054-a950-032a47b72950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbfb33f-a103-4054-a950-032a47b72950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdcb2dff-6f23-4b65-a75b-2558929e9480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Volume e82c59a4-e60a-4db4-b93b-38328b23137b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82c59a4-e60a-4db4-b93b-38328b23137b', 'volume_size': 1} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1332480698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82c59a4-e60a-4db4-b93b-38328b23137b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:56Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Creating volume e82c59a4-e60a-4db4-b93b-38328b23137b {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:56 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b 1073741824 Aug 05 15:51:56 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:56 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b 1073741824" returned: 0 in 0.580s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:57 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b Aug 05 15:51:57 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:57 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b" returned: 0 in 0.372s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdcb2dff-6f23-4b65-a75b-2558929e9480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82c59a4-e60a-4db4-b93b-38328b23137b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7192d90-5c7d-44a0-86a1-30bbeddcbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Volume volume-e82c59a4-e60a-4db4-b93b-38328b23137b (e82c59a4-e60a-4db4-b93b-38328b23137b): created successfully Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7192d90-5c7d-44a0-86a1-30bbeddcbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (8f7ec976-0394-4eeb-9afe-98e99db69433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-684a9afd-4057-4111-a55d-ee5c8934b258 tempest-AttachVolumeNegativeTest-999683015 None] Created volume successfully. Aug 05 15:51:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Flow 'volume_create_manager' (3a7073b1-5c6a-453f-90a2-95efbd46f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6839fdd-e9cd-41c9-8659-2f148d09b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6839fdd-e9cd-41c9-8659-2f148d09b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-249049002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239922d5-2d02-46c2-87b8-9b7141c2a81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c5c937759741e19a69799e91641b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:59Z,use_quota=True,user_id='68d8e3259daa44b6829bf514a26f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b9cf4-1e22-421d-a9b1-ac3611cf9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b9cf4-1e22-421d-a9b1-ac3611cf9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f847a1-58ed-462d-aeb2-3fa292ee2214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f847a1-58ed-462d-aeb2-3fa292ee2214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239922d5-2d02-46c2-87b8-9b7141c2a81c', 'volume_name': 'volume-239922d5-2d02-46c2-87b8-9b7141c2a81c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19b2ea-4ca2-4335-86ec-322ae63a0efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19b2ea-4ca2-4335-86ec-322ae63a0efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8815a319-80c7-407b-b4cb-33e91afa915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Volume 239922d5-2d02-46c2-87b8-9b7141c2a81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239922d5-2d02-46c2-87b8-9b7141c2a81c', 'volume_size': 1} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-249049002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239922d5-2d02-46c2-87b8-9b7141c2a81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08c5c937759741e19a69799e91641b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:59Z,use_quota=True,user_id='68d8e3259daa44b6829bf514a26f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Creating volume 239922d5-2d02-46c2-87b8-9b7141c2a81c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:51:59 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c 1073741824 Aug 05 15:51:59 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Flow 'volume_create_manager' (c476b94b-9dff-4b31-b362-f627d13463e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5a40e4-eed4-4970-a728-78804dc05596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5a40e4-eed4-4970-a728-78804dc05596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-964737391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb16067-d9a9-4eb5-a990-96ad3adab586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ffdddbc413458d80e2e32c376c848b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:59Z,use_quota=True,user_id='dce4b08cbb504ef68f23a7f196c79bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61058af-8882-4278-8f3f-d6acb6a0a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61058af-8882-4278-8f3f-d6acb6a0a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3e5c76-a70a-4d7a-89b7-fb4d8fadd69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3e5c76-a70a-4d7a-89b7-fb4d8fadd69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb16067-d9a9-4eb5-a990-96ad3adab586', 'volume_name': 'volume-cbb16067-d9a9-4eb5-a990-96ad3adab586', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4051655-282f-4a32-9509-7d0bd6754da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4051655-282f-4a32-9509-7d0bd6754da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4944da-288b-49dd-8a51-cfd82170f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Volume cbb16067-d9a9-4eb5-a990-96ad3adab586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb16067-d9a9-4eb5-a990-96ad3adab586', 'volume_size': 1} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:59 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c 1073741824" returned: 0 in 0.540s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c Aug 05 15:51:59 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:59 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.523s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8815a319-80c7-407b-b4cb-33e91afa915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239922d5-2d02-46c2-87b8-9b7141c2a81c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47463d88-b397-4a14-a4ec-acf865a36d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daed476-c718-43ce-9bcf-f369a00e2942]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Volume volume-239922d5-2d02-46c2-87b8-9b7141c2a81c (239922d5-2d02-46c2-87b8-9b7141c2a81c): created successfully Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47463d88-b397-4a14-a4ec-acf865a36d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Flow 'volume_create_manager' (3a7073b1-5c6a-453f-90a2-95efbd46f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-70316d99-aadc-47b0-9fac-e20d169b88e4 tempest-AttachVolumeShelveTestJSON-1676361865 None] Created volume successfully. Aug 05 15:52:00 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b Aug 05 15:52:00 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:00 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b" returned: 0 in 0.357s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.384s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-964737391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb16067-d9a9-4eb5-a990-96ad3adab586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ffdddbc413458d80e2e32c376c848b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:59Z,use_quota=True,user_id='dce4b08cbb504ef68f23a7f196c79bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Creating volume cbb16067-d9a9-4eb5-a990-96ad3adab586 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:52:00 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:00 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 1073741824 Aug 05 15:52:00 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-e82c59a4-e60a-4db4-b93b-38328b23137b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e72962a-2816-453d-a036-0a0c5f9bb680', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:52:00 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-0b37a92a-d554-42a8-a501-d53a68f14047 req-d2369415-1d88-4312-9ff2-9c1583e07657 tempest-AttachVolumeNegativeTest-999683015 None] attachment_update completed successfully. Aug 05 15:52:00 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 1073741824" returned: 0 in 0.526s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:00 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 Aug 05 15:52:00 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:01 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4944da-288b-49dd-8a51-cfd82170f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb16067-d9a9-4eb5-a990-96ad3adab586', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b4d2dd-6d1a-48a4-afa1-71741ad45601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Volume volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 (cbb16067-d9a9-4eb5-a990-96ad3adab586): created successfully Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b4d2dd-6d1a-48a4-afa1-71741ad45601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Flow 'volume_create_manager' (c476b94b-9dff-4b31-b362-f627d13463e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-de6a24e9-fe72-4d34-8ae0-0a08513efb3d tempest-VolumesNegativeTest-1244310401 None] Created volume successfully. Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (0130edbc-5475-457c-9064-011d462487d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20cd91-af52-40ab-912d-8ffb1c5783ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20cd91-af52-40ab-912d-8ffb1c5783ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2122820685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b3e721-3e10-4362-abe7-2cffb3761c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:03Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f7ec0-375d-4e20-9597-78abf09200f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0f7ec0-375d-4e20-9597-78abf09200f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb3bf0-8787-439f-9b1f-013821ad05d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb3bf0-8787-439f-9b1f-013821ad05d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b3e721-3e10-4362-abe7-2cffb3761c24', 'volume_name': 'volume-a8b3e721-3e10-4362-abe7-2cffb3761c24', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9366ba-13a6-4a61-8968-d00c27bfefc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9366ba-13a6-4a61-8968-d00c27bfefc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1821f53f-c1ae-40b1-94f1-551667207a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Volume a8b3e721-3e10-4362-abe7-2cffb3761c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b3e721-3e10-4362-abe7-2cffb3761c24', 'volume_size': 1} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2122820685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b3e721-3e10-4362-abe7-2cffb3761c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:03Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Creating volume a8b3e721-3e10-4362-abe7-2cffb3761c24 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:52:03 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:03 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 1073741824 Aug 05 15:52:03 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:03 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:52:03 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:03 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 1073741824" returned: 0 in 0.797s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:03 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 Aug 05 15:52:03 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-04480bcb-2c84-4d9f-99c1-9cd54a1001dc req-bfea2c73-fa3c-4914-a74d-9c22d76514d9 tempest-AttachVolumeNegativeTest-999683015 None] Terminate volume connection completed successfully. Aug 05 15:52:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-04480bcb-2c84-4d9f-99c1-9cd54a1001dc req-bfea2c73-fa3c-4914-a74d-9c22d76514d9 tempest-AttachVolumeNegativeTest-999683015 None] Deleting attachment 2e72962a-2816-453d-a036-0a0c5f9bb680. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:52:04 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:52:04 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24" returned: 0 in 0.438s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1821f53f-c1ae-40b1-94f1-551667207a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b3e721-3e10-4362-abe7-2cffb3761c24', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d575e1f6-3f33-42a2-b9f3-0a65f7a0552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Volume volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 (a8b3e721-3e10-4362-abe7-2cffb3761c24): created successfully Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d575e1f6-3f33-42a2-b9f3-0a65f7a0552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (0130edbc-5475-457c-9064-011d462487d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7b264769-bd36-436b-9239-af406d3b948c tempest-AttachVolumeTestJSON-1654015949 None] Created volume successfully. Aug 05 15:52:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[623beced-f6d5-406f-b786-4d8bd8a5397e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:06 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 Aug 05 15:52:06 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:07 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24" returned: 0 in 0.582s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-a8b3e721-3e10-4362-abe7-2cffb3761c24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc077222-051c-4159-963b-ae4342dc5404', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:52:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-2faae2ad-19f9-4d0c-8f45-ff40ef45b74c req-ba75c222-b1c2-4628-8eb1-323d7e544458 tempest-AttachVolumeTestJSON-1654015949 None] attachment_update completed successfully. Aug 05 15:52:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-34a2dcf0-6d30-4b72-927b-9afdf392a1a9 req-35421e83-8dab-4899-b3e2-fca5d0beb152 tempest-AttachVolumeShelveTestJSON-1676361865 None] No connector for attachment ef766140-86c2-4abf-80d5-bd7ab4c15522; skipping storage backend terminate_connection call. {{(pid=88715) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 05 15:52:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-34a2dcf0-6d30-4b72-927b-9afdf392a1a9 req-35421e83-8dab-4899-b3e2-fca5d0beb152 tempest-AttachVolumeShelveTestJSON-1676361865 None] Deleting attachment ef766140-86c2-4abf-80d5-bd7ab4c15522. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:52:23 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=48,cinder:SELECT=43,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:23 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=42,cinder:INSERT=10,cinder:UPDATE=49,cinder:DELETE=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Acquiring lock "cinder-cbb16067-d9a9-4eb5-a990-96ad3adab586-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "cinder-cbb16067-d9a9-4eb5-a990-96ad3adab586-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Acquiring lock "cinder-quobyte-cbb16067-d9a9-4eb5-a990-96ad3adab586" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "cinder-quobyte-cbb16067-d9a9-4eb5-a990-96ad3adab586" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc53760-ec07-40a5-879b-32589ef140a7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:36 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 Aug 05 15:52:36 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:36 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:36 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586 Aug 05 15:52:36 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:36 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cbb16067-d9a9-4eb5-a990-96ad3adab586" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "cinder-quobyte-cbb16067-d9a9-4eb5-a990-96ad3adab586" released by "delete_volume" :: held 0.752s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Created reservations ['683a86e0-83cf-4cd6-a9e0-026095654910', '4025a5de-d949-424c-a306-edf6bc09f4c3', 'cfe6eafb-b4dc-476d-ac53-f9c2638aabd7', '1cfe9bc0-2f62-4fa0-bc86-a9436435bea4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:36 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:52:36 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:37 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:37 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Deleted volume successfully. Aug 05 15:52:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6b827d1-11b6-445e-83f4-89afe94f7221 tempest-VolumesNegativeTest-1244310401 None] Lock "cinder-cbb16067-d9a9-4eb5-a990-96ad3adab586-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:46 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:47 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (49d94430-0627-4522-93e8-8aad78551a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da24126-cd4f-4e7f-94c1-c89e4e7d9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da24126-cd4f-4e7f-94c1-c89e4e7d9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1575654937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3901c518-1d8c-42a4-8468-3dfc37ed8f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:55Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b88e0f-95aa-4932-a7c0-067e5ce7925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b88e0f-95aa-4932-a7c0-067e5ce7925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984d35c2-f8d4-43aa-a123-4a9c156b6782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984d35c2-f8d4-43aa-a123-4a9c156b6782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3901c518-1d8c-42a4-8468-3dfc37ed8f26', 'volume_name': 'volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfa885b-5f08-4a85-aca9-c9adae00ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfa885b-5f08-4a85-aca9-c9adae00ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7b96ca-dc56-4e4e-8276-725c6c35edde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Volume 3901c518-1d8c-42a4-8468-3dfc37ed8f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26', 'volume_size': 1} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1575654937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3901c518-1d8c-42a4-8468-3dfc37ed8f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b4ab3d664647b88ae733eef77edc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:55Z,use_quota=True,user_id='b7d3083d425445a5a2ead32c7e827cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Creating volume 3901c518-1d8c-42a4-8468-3dfc37ed8f26 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:52:54 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:52:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:54 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 1073741824 Aug 05 15:52:54 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:55 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 1073741824" returned: 0 in 0.589s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:55 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 Aug 05 15:52:55 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:55 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26" returned: 0 in 0.565s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7b96ca-dc56-4e4e-8276-725c6c35edde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8545f96-925c-403a-ad58-57197bbaba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Volume volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 (3901c518-1d8c-42a4-8468-3dfc37ed8f26): created successfully Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8545f96-925c-403a-ad58-57197bbaba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Flow 'volume_create_manager' (49d94430-0627-4522-93e8-8aad78551a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-daa62d3a-ea4f-46cb-9114-fb89ce1e4008 tempest-AttachVolumeNegativeTest-999683015 None] Created volume successfully. Aug 05 15:52:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2b5e0-6a0e-4df2-8044-989d287c6270]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:58 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 Aug 05 15:52:58 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:58 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26" returned: 0 in 0.526s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.552s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31da6254-d233-4110-ad74-cf37bb858b62', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:52:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-698878bb-5644-42c0-ae50-a8d4176a13d7 req-62eee2b0-7a12-4a1f-b8a3-71e7e15fe65d tempest-AttachVolumeNegativeTest-999683015 None] attachment_update completed successfully. Aug 05 15:52:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-b04d2f94-cf14-4ca4-9500-4e1d3a5f472f req-f87306b4-d2e7-4bda-a1b0-869ee4715de7 tempest-AttachVolumeTestJSON-1654015949 None] Terminate volume connection completed successfully. Aug 05 15:52:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-b04d2f94-cf14-4ca4-9500-4e1d3a5f472f req-f87306b4-d2e7-4bda-a1b0-869ee4715de7 tempest-AttachVolumeTestJSON-1654015949 None] Deleting attachment fc077222-051c-4159-963b-ae4342dc5404. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Acquiring lock "cinder-239922d5-2d02-46c2-87b8-9b7141c2a81c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "cinder-239922d5-2d02-46c2-87b8-9b7141c2a81c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Acquiring lock "cinder-quobyte-239922d5-2d02-46c2-87b8-9b7141c2a81c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "cinder-quobyte-239922d5-2d02-46c2-87b8-9b7141c2a81c" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[38670d23-2b84-4081-aebf-7648840abec9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:00 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c Aug 05 15:53:00 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-2691b199-1903-4e6c-9bea-a0dc775ab082 req-e0df9d4b-bbbb-400b-a09e-3785280ca86c tempest-AttachVolumeNegativeTest-999683015 None] Terminate volume connection completed successfully. Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-2691b199-1903-4e6c-9bea-a0dc775ab082 req-e0df9d4b-bbbb-400b-a09e-3785280ca86c tempest-AttachVolumeNegativeTest-999683015 None] Deleting attachment 31da6254-d233-4110-ad74-cf37bb858b62. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:53:01 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:01 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c Aug 05 15:53:01 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:01 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-239922d5-2d02-46c2-87b8-9b7141c2a81c" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "cinder-quobyte-239922d5-2d02-46c2-87b8-9b7141c2a81c" released by "delete_volume" :: held 0.870s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Created reservations ['3256d126-05b8-4002-b519-5282ea2d14e2', '1ae85c61-ee24-4fe2-8c78-bc42ca212e74', '040bd782-a689-441d-8a07-136865fedb00', '4ed02c7d-a23a-4cc3-854e-7aa9aab73381'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:01 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:01 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:02 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.368s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:02 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Deleted volume successfully. Aug 05 15:53:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e56a90b3-e41c-43b4-b437-c3fa80ecaa5b tempest-AttachVolumeShelveTestJSON-1676361865 None] Lock "cinder-239922d5-2d02-46c2-87b8-9b7141c2a81c-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:03 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:03 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:04 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.325s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:53:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:53:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-3901c518-1d8c-42a4-8468-3dfc37ed8f26-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-3901c518-1d8c-42a4-8468-3dfc37ed8f26-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-quobyte-3901c518-1d8c-42a4-8468-3dfc37ed8f26" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-3901c518-1d8c-42a4-8468-3dfc37ed8f26" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cbb7e6-2099-47b8-94b2-7a4f704d7c10]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:08 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 Aug 05 15:53:08 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:08 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26" returned: 0 in 0.605s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:08 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26 Aug 05 15:53:08 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:08 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3901c518-1d8c-42a4-8468-3dfc37ed8f26" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-3901c518-1d8c-42a4-8468-3dfc37ed8f26" released by "delete_volume" :: held 1.063s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Created reservations ['9839928c-ffb2-41fd-9ac3-2bd1cd62a113', '0c830131-cfa9-4557-ac85-19a829446efb', '9cc02b27-14d3-4b6e-a387-a5ed66d82ea4', '62892de6-9f3f-4850-896d-3c96576a45b6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:09 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:09 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:09 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.464s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Deleted volume successfully. Aug 05 15:53:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-293d782b-891a-479b-81ae-c0b82cb888a2 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-3901c518-1d8c-42a4-8468-3dfc37ed8f26-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-e82c59a4-e60a-4db4-b93b-38328b23137b-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-e82c59a4-e60a-4db4-b93b-38328b23137b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-quobyte-e82c59a4-e60a-4db4-b93b-38328b23137b" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-e82c59a4-e60a-4db4-b93b-38328b23137b" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2b8c0a-7c7e-49b4-af72-2eaeb64ee631]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:10 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b Aug 05 15:53:10 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:11 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b" returned: 0 in 0.754s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:11 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b Aug 05 15:53:11 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:11 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e82c59a4-e60a-4db4-b93b-38328b23137b" returned: 0 in 0.487s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-e82c59a4-e60a-4db4-b93b-38328b23137b" released by "delete_volume" :: held 1.325s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Created reservations ['59399890-2382-4635-aafc-6a5e74cbfaf5', '1c1e83cd-0666-4dde-8210-96e02277eccf', '477189ad-1eed-4a94-a300-eacb0eaab3c5', '03d2a0c8-f2da-4f60-beb9-f6b9ec634231'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:12 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:12 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:12 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.699s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Deleted volume successfully. Aug 05 15:53:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-84420a93-1246-4852-b7e5-e3fa4e8f5f63 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-e82c59a4-e60a-4db4-b93b-38328b23137b-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-b9db2df9-857d-4b21-a9e3-947e06e273f5-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-b9db2df9-857d-4b21-a9e3-947e06e273f5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "cinder-quobyte-b9db2df9-857d-4b21-a9e3-947e06e273f5" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-b9db2df9-857d-4b21-a9e3-947e06e273f5" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73606c-4b74-4b35-a877-55c54f791059]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:13 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 Aug 05 15:53:13 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:13 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5" returned: 0 in 0.548s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:13 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5 Aug 05 15:53:13 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:14 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b9db2df9-857d-4b21-a9e3-947e06e273f5" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-quobyte-b9db2df9-857d-4b21-a9e3-947e06e273f5" released by "delete_volume" :: held 0.960s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Created reservations ['ebe2a11f-d675-46c6-9c41-176214eb155c', '2670da18-3ad4-4095-9e2b-f9e73951de9d', '7bc08d1c-b1ab-48f3-ae0f-fc91ee03de73', '6d95c6bc-ca1a-4af5-a3db-3f99b07682b3'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:14 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:14 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:14 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.319s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Deleted volume successfully. Aug 05 15:53:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49184f49-35ca-4d9b-a0db-6fb935c70127 tempest-AttachVolumeNegativeTest-999683015 None] Lock "cinder-b9db2df9-857d-4b21-a9e3-947e06e273f5-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:24 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=37,cinder:SELECT=32,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:53:24 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:53:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-79f7046d-5d33-4076-bbb2-cc23d08fc2e3 tempest-GroupsV320Test-122174107 None] Group tempest-GroupsV320Test-Group-322455120: creating Aug 05 15:53:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-79f7046d-5d33-4076-bbb2-cc23d08fc2e3 tempest-GroupsV320Test-122174107 None] Group tempest-GroupsV320Test-Group-322455120: created successfully Aug 05 15:53:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-79f7046d-5d33-4076-bbb2-cc23d08fc2e3 tempest-GroupsV320Test-122174107 None] Create group completed successfully. Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Flow 'volume_create_manager' (3980b433-8a8a-4fc7-84ba-07a34de56b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6447fe1b-598c-473c-973a-83266583fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6447fe1b-598c-473c-973a-83266583fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-85411625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181f0e32-3329-40d5-8caa-9178cac8f210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7c4c661d1b44019825943e09691ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:28Z,use_quota=True,user_id='4ad03dbdb87c4da984be8abe3bb013ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa8acf6-c6fe-474d-b3f9-1a12430a605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa8acf6-c6fe-474d-b3f9-1a12430a605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d14600-c3f7-4aa2-bf53-c53e10f8ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d14600-c3f7-4aa2-bf53-c53e10f8ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181f0e32-3329-40d5-8caa-9178cac8f210', 'volume_name': 'volume-181f0e32-3329-40d5-8caa-9178cac8f210', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bdb36c-970c-44f8-be54-cf5d3a2118d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bdb36c-970c-44f8-be54-cf5d3a2118d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949f20ba-bd94-468c-a17b-a25cd3026b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Volume 181f0e32-3329-40d5-8caa-9178cac8f210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181f0e32-3329-40d5-8caa-9178cac8f210', 'volume_size': 1} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-85411625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181f0e32-3329-40d5-8caa-9178cac8f210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7c4c661d1b44019825943e09691ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:28Z,use_quota=True,user_id='4ad03dbdb87c4da984be8abe3bb013ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Creating volume 181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:53:27 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:53:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:27 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 1073741824 Aug 05 15:53:27 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Created reservations ['3902cfcf-d097-41e0-9c76-b79f127376f4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:28 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:28 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:28 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 1073741824" returned: 0 in 0.518s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:28 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 Aug 05 15:53:28 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:28 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-59e5aacf-3dee-494e-89c4-74ec6ef3e3df tempest-GroupsV320Test-122174107 None] Delete group completed successfully. Aug 05 15:53:28 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210" returned: 0 in 0.258s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949f20ba-bd94-468c-a17b-a25cd3026b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181f0e32-3329-40d5-8caa-9178cac8f210', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65923b99-0170-44b3-ac1a-131cd19b70f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:28 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Volume volume-181f0e32-3329-40d5-8caa-9178cac8f210 (181f0e32-3329-40d5-8caa-9178cac8f210): created successfully Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65923b99-0170-44b3-ac1a-131cd19b70f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Flow 'volume_create_manager' (3980b433-8a8a-4fc7-84ba-07a34de56b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-64b78c60-3403-41b3-b605-44bbe4bdf6bd req-45dc4c11-28ad-4b4e-a89f-1114e02efd03 tempest-VolumesSnapshotsTestJSON-760819311 None] Created volume successfully. Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Creating offline snapshot 4f563a37-2557-4ee9-8719-d1ec3555f9d8 of volume 181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e20034d-81ff-498e-a411-cd498758bb34]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:29 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 Aug 05 15:53:29 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:29 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210" returned: 0 in 0.453s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:29 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 1G Aug 05 15:53:29 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:29 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 1G" returned: 0 in 0.469s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181f0e32-3329-40d5-8caa-9178cac8f210 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:29 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181f0e32-3329-40d5-8caa-9178cac8f210 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 Aug 05 15:53:29 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:30 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181f0e32-3329-40d5-8caa-9178cac8f210 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8" returned: 0 in 0.433s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:30 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 is being set with open permissions: ugo+rw Aug 05 15:53:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:30 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 Aug 05 15:53:30 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:30 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8" returned: 0 in 0.394s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:30 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info Aug 05 15:53:30 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:31 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info" returned: 0 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:31 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info is being set with open permissions: ugo+rw Aug 05 15:53:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:31 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info Aug 05 15:53:31 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:31 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.info" returned: 0 in 0.380s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-f1a0bbf9-d80f-483f-9225-b0e81b35d456 req-3f133ae1-4799-46f0-8aca-8e9b3560f473 tempest-VolumesSnapshotsTestJSON-760819311 None] Create snapshot completed successfully Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "cinder-4f563a37-2557-4ee9-8719-d1ec3555f9d8-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-4f563a37-2557-4ee9-8719-d1ec3555f9d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "cinder-quobyte-4f563a37-2557-4ee9-8719-d1ec3555f9d8" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-4f563a37-2557-4ee9-8719-d1ec3555f9d8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Deleting offline snapshot 4f563a37-2557-4ee9-8719-d1ec3555f9d8 of volume 181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] snapshot_file for this snap is: volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261d85e-91a6-4f51-9695-3aabe98f06c8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:32 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 Aug 05 15:53:32 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:33 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8" returned: 0 in 0.566s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-181f0e32-3329-40d5-8caa-9178cac8f210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0c0f62-bca3-4937-9e21-87c9a750e8cf]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:33 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 Aug 05 15:53:33 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:33 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210" returned: 0 in 0.595s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:33 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 Aug 05 15:53:33 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:34 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8" returned: 0 in 0.529s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:34 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8 Aug 05 15:53:34 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:34 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210.4f563a37-2557-4ee9-8719-d1ec3555f9d8" returned: 0 in 0.336s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-4f563a37-2557-4ee9-8719-d1ec3555f9d8" released by "_delete_snapshot" :: held 2.217s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" released by "delete_snapshot" :: held 2.248s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:34 devstack cinder-volume[88715]: DEBUG cinder.quota [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Created reservations ['b1f127e6-64db-4426-ad2c-e0fcb454acd7', 'cbcb6726-751b-48d5-8292-7feba6aaee9e', '3751a103-3ae0-45db-8a98-5f1e387e97a0', 'd8efa128-ad82-4636-ad99-723f34c535e9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Delete snapshot completed successfully. Aug 05 15:53:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-a78f881e-b176-437b-8f0b-644190d815cd req-cb397469-0b38-4df4-bda0-93b6ddef5311 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-4f563a37-2557-4ee9-8719-d1ec3555f9d8-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "cinder-181f0e32-3329-40d5-8caa-9178cac8f210-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-181f0e32-3329-40d5-8caa-9178cac8f210-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa6ca29-3cad-4947-a61c-4e064719ee20]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Flow 'volume_create_manager' (d787d3c7-ba4a-4ede-9a3f-9ce3e69881f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887a44c-5bb4-4ca6-9a16-e32af2ee7b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c887a44c-5bb4-4ca6-9a16-e32af2ee7b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1060056017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16caae98-c453-4669-a9e2-458e69929273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e8709520e74223bed0aeaa9757298d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:36Z,use_quota=True,user_id='38bc25046e5445a39782fedbba80eb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6309620-44e8-41c3-934c-c93eb066e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6309620-44e8-41c3-934c-c93eb066e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a0674-914c-4a1a-befb-3ee45409115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a0674-914c-4a1a-befb-3ee45409115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16caae98-c453-4669-a9e2-458e69929273', 'volume_name': 'volume-16caae98-c453-4669-a9e2-458e69929273', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dc8e2f-d9c5-4b51-b365-5f660acf8b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dc8e2f-d9c5-4b51-b365-5f660acf8b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:36 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 Aug 05 15:53:36 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d01181-af5b-423b-aab3-234f43671a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:36 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Volume 16caae98-c453-4669-a9e2-458e69929273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16caae98-c453-4669-a9e2-458e69929273', 'volume_size': 1} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1060056017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16caae98-c453-4669-a9e2-458e69929273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e8709520e74223bed0aeaa9757298d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:36Z,use_quota=True,user_id='38bc25046e5445a39782fedbba80eb3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Creating volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:53:36 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:36 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 1073741824 Aug 05 15:53:36 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:36 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210" returned: 0 in 0.408s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:36 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210 Aug 05 15:53:36 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:36 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 1073741824" returned: 0 in 0.504s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:36 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-181f0e32-3329-40d5-8caa-9178cac8f210" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:36 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 Aug 05 15:53:36 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-quobyte-181f0e32-3329-40d5-8caa-9178cac8f210" released by "delete_volume" :: held 0.829s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:36 devstack cinder-volume[88715]: DEBUG cinder.quota [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Created reservations ['4ff7e57b-44d5-4bb3-9408-983d1a05a190', '15beed7c-a35f-476d-99ab-3bdc2441b3f2', 'b68b27f8-db88-4978-a7b9-0b2270692a07', '8df420be-7ea4-46b9-b7ec-5a687ee411d9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:37 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:37 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:37 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273" returned: 0 in 0.312s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d01181-af5b-423b-aab3-234f43671a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16caae98-c453-4669-a9e2-458e69929273', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44edae76-7ace-4310-9650-cbaec0ca4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:37 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Volume volume-16caae98-c453-4669-a9e2-458e69929273 (16caae98-c453-4669-a9e2-458e69929273): created successfully Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44edae76-7ace-4310-9650-cbaec0ca4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Flow 'volume_create_manager' (d787d3c7-ba4a-4ede-9a3f-9ce3e69881f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e353c58d-8ef5-4859-8cda-5665d08b7cef tempest-SnapshotsActionsTest-475281208 None] Created volume successfully. Aug 05 15:53:37 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.334s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.manager [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Deleted volume successfully. Aug 05 15:53:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-8f23ce62-2b69-44b8-9ecd-bc209e6afc29 req-bc703ec2-c4fa-4a2b-b844-1781799bde05 tempest-VolumesSnapshotsTestJSON-760819311 None] Lock "cinder-181f0e32-3329-40d5-8caa-9178cac8f210-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Creating offline snapshot 99c6e41d-dcb2-4f2a-84ea-111326f78d2e of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b03564-13f9-48fa-8e50-16fb321800d8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:38 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 Aug 05 15:53:38 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:39 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:39 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e 1G Aug 05 15:53:39 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:39 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e 1G" returned: 0 in 0.693s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:39 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:39 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:40 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:40 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e is being set with open permissions: ugo+rw Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:40 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:40 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:40 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:40 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info Aug 05 15:53:40 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:40 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:40 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info is being set with open permissions: ugo+rw Aug 05 15:53:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:40 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info Aug 05 15:53:40 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:41 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.info" returned: 0 in 0.304s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2c570925-b6ec-47e4-994e-6085c130b3e2 tempest-SnapshotsActionsTest-475281208 None] Create snapshot completed successfully Aug 05 15:53:41 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Flow 'volume_create_manager' (3956d537-93b9-4695-a68e-2d48217e1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8a5e64-dbc8-4a8d-889c-0c8768b13111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8a5e64-dbc8-4a8d-889c-0c8768b13111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-879508612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34be0d35-6a56-4d31-ab8e-f4c526cc7b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b69221a549e4fd1b7cb99fe113059de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:42Z,use_quota=True,user_id='c2c5e62a19a945369eb82a9ecabd6a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71665b4b-c6de-4390-b1d1-256a599ebd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71665b4b-c6de-4390-b1d1-256a599ebd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a46ecc4-16c9-41ac-ace3-cf6506366dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a46ecc4-16c9-41ac-ace3-cf6506366dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34be0d35-6a56-4d31-ab8e-f4c526cc7b95', 'volume_name': 'volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1923d0f-6192-44a0-8f38-1b3c71f89a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1923d0f-6192-44a0-8f38-1b3c71f89a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5629e9-8625-43a8-99fa-2844aacb7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Volume 34be0d35-6a56-4d31-ab8e-f4c526cc7b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95', 'volume_size': 1} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-879508612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34be0d35-6a56-4d31-ab8e-f4c526cc7b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b69221a549e4fd1b7cb99fe113059de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:42Z,use_quota=True,user_id='c2c5e62a19a945369eb82a9ecabd6a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Creating volume 34be0d35-6a56-4d31-ab8e-f4c526cc7b95 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:53:42 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:42 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 1073741824 Aug 05 15:53:42 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:42 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 1073741824" returned: 0 in 0.805s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:43 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 Aug 05 15:53:43 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:43 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.521s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5629e9-8625-43a8-99fa-2844aacb7ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbea013-cc2c-44ba-8663-cdbce479a197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Creating offline snapshot 8bf90319-9284-40a4-b603-499187d743c3 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Volume volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 (34be0d35-6a56-4d31-ab8e-f4c526cc7b95): created successfully Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbea013-cc2c-44ba-8663-cdbce479a197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Flow 'volume_create_manager' (3956d537-93b9-4695-a68e-2d48217e1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ce063-efba-450e-bd62-2c5f4af1308e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-76af10e0-10e6-4778-a4f1-58ca43d1e46c req-04ed81be-171c-4522-b378-f7465856db51 tempest-VolumesGetTestJSON-2118736168 None] Created volume successfully. Aug 05 15:53:43 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:43 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:43 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:43 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 1G Aug 05 15:53:43 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:44 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 1G" returned: 0 in 0.620s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:44 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 Aug 05 15:53:44 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Acquiring lock "cinder-34be0d35-6a56-4d31-ab8e-f4c526cc7b95-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "cinder-34be0d35-6a56-4d31-ab8e-f4c526cc7b95-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Acquiring lock "cinder-quobyte-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "cinder-quobyte-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1db83b-d11d-4656-87bf-e4b5aef7505f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:44 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3" returned: 0 in 0.438s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:44 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 is being set with open permissions: ugo+rw Aug 05 15:53:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:44 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 Aug 05 15:53:44 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:44 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 Aug 05 15:53:44 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:45 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" returned: 0 in 0.491s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:45 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3" returned: 0 in 0.488s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:45 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95 Aug 05 15:53:45 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b7d93e61-c34d-44ff-8e1f-823febc2c648 tempest-SnapshotsActionsTest-475281208 None] Create snapshot completed successfully Aug 05 15:53:45 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" returned: 0 in 0.711s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "cinder-quobyte-34be0d35-6a56-4d31-ab8e-f4c526cc7b95" released by "delete_volume" :: held 1.288s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Flow 'volume_create_manager' (0c27cac8-8760-440b-822b-825f44ae3c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f16b2e-05bf-471d-870c-1e8ebb592c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f16b2e-05bf-471d-870c-1e8ebb592c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1086953891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55398d0-a09e-45fc-bc2d-74527573ca26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b9f701c9e147a89357db82e006aea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='d10de2bd72f9485ba06ac7c1879cce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47efb90-f5bf-4147-9b04-c41fd68a8f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47efb90-f5bf-4147-9b04-c41fd68a8f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d380800-4c11-4635-9864-1138f6f5441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d380800-4c11-4635-9864-1138f6f5441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55398d0-a09e-45fc-bc2d-74527573ca26', 'volume_name': 'volume-f55398d0-a09e-45fc-bc2d-74527573ca26', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6862d5a9-f25d-47c9-9c3c-bdc58d4af5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6862d5a9-f25d-47c9-9c3c-bdc58d4af5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef833a-bcb1-40ea-9f01-11e43935f070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Volume f55398d0-a09e-45fc-bc2d-74527573ca26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55398d0-a09e-45fc-bc2d-74527573ca26', 'volume_size': 1} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1086953891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55398d0-a09e-45fc-bc2d-74527573ca26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b9f701c9e147a89357db82e006aea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='d10de2bd72f9485ba06ac7c1879cce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Creating volume f55398d0-a09e-45fc-bc2d-74527573ca26 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:53:46 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.quota [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Created reservations ['518a099f-2549-4485-b7ca-4fa3e1f8f736', '8eca9240-aaf7-46f6-b9ac-3504d0e2c955', 'ce8b1b71-9d5c-4434-b918-09bf66a11663', 'b712ed22-5239-45d1-8e32-e4d8266d724c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:46 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 1073741824 Aug 05 15:53:46 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-8bf90319-9284-40a4-b603-499187d743c3-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-8bf90319-9284-40a4-b603-499187d743c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-8bf90319-9284-40a4-b603-499187d743c3" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-8bf90319-9284-40a4-b603-499187d743c3" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Deleting offline snapshot 8bf90319-9284-40a4-b603-499187d743c3 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] snapshot_file for this snap is: volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ceb1f9-851c-4591-a039-38940d97a9f3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:46 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:46 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:46 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 Aug 05 15:53:46 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:46 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.340s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.manager [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Deleted volume successfully. Aug 05 15:53:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-cc33b586-4c73-497e-bb06-e1488cc6a4ee req-24cf7fb1-e998-41b4-ae48-18571490c415 tempest-VolumesGetTestJSON-2118736168 None] Lock "cinder-34be0d35-6a56-4d31-ab8e-f4c526cc7b95-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:47 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 1073741824" returned: 0 in 0.705s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:47 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 Aug 05 15:53:47 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:47 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3" returned: 0 in 0.561s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc6612-21f6-4d18-a57f-10b850f5b9a1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:47 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:47 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:47 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef833a-bcb1-40ea-9f01-11e43935f070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55398d0-a09e-45fc-bc2d-74527573ca26', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3bd9e9-36b0-454d-9031-9e1f4533802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Volume volume-f55398d0-a09e-45fc-bc2d-74527573ca26 (f55398d0-a09e-45fc-bc2d-74527573ca26): created successfully Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3bd9e9-36b0-454d-9031-9e1f4533802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Flow 'volume_create_manager' (0c27cac8-8760-440b-822b-825f44ae3c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-96cf4aec-dd0a-4cd9-9d8f-9ec30cb482eb tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Created volume successfully. Aug 05 15:53:47 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.501s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:47 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 Aug 05 15:53:47 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:48 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3" returned: 0 in 0.696s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:48 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3 Aug 05 15:53:48 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:48 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.8bf90319-9284-40a4-b603-499187d743c3" returned: 0 in 0.544s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-8bf90319-9284-40a4-b603-499187d743c3" released by "_delete_snapshot" :: held 2.548s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_snapshot" :: held 2.620s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Created reservations ['da95fc38-e69f-435c-bdcd-22a09c5f6e00', '3ae2bef3-e430-4f4c-9525-f4de5072368e', '93bd58c9-b963-495c-b408-221011ab966d', '54c37702-5e51-4635-b9d9-23d3024c9d1f'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Delete snapshot completed successfully. Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-edf04e2e-bb5f-4fe0-bca6-ca052dbd5ea6 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-8bf90319-9284-40a4-b603-499187d743c3-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0b51e-de18-4224-8c29-a2822ae3af4f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 Aug 05 15:53:49 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:50 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26" returned: 0 in 0.498s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-f55398d0-a09e-45fc-bc2d-74527573ca26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb3e3346-fe27-4e56-a2f9-16a7d3e573d9', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:53:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-092a0093-b1f6-489e-8c94-767ba4265140 req-fa25b0da-8c5e-4a78-b6a5-8fde7138cbd9 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] attachment_update completed successfully. Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Creating offline snapshot f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d279f9fa-c4e6-4f73-a1e7-9e910d9a8f60]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:50 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:50 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.689s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 1G Aug 05 15:53:51 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 1G" returned: 0 in 0.911s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 Aug 05 15:53:52 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" returned: 0 in 0.466s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 is being set with open permissions: ugo+rw Aug 05 15:53:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 Aug 05 15:53:52 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0e382936-f5fe-4de6-a1bf-6fa2731e9239 tempest-SnapshotsActionsTest-475281208 None] Create snapshot completed successfully Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Deleting offline snapshot f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:53:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] snapshot_file for this snap is: volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c6be3-acb3-444d-8778-76c6e70fd0af]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 Aug 05 15:53:54 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" returned: 0 in 0.555s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5f0b3-6987-4e65-963c-0c91da55967a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:54 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.527s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 Aug 05 15:53:55 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-28719f20-5b60-42f3-99c8-400f7cadc27d req-f9f6c7c7-4cbd-4bec-b44f-6a440f6e63e0 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Terminate volume connection completed successfully. Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-28719f20-5b60-42f3-99c8-400f7cadc27d req-f9f6c7c7-4cbd-4bec-b44f-6a440f6e63e0 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Deleting attachment fb3e3346-fe27-4e56-a2f9-16a7d3e573d9. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:53:55 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" returned: 0 in 0.548s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9 Aug 05 15:53:55 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9" released by "_delete_snapshot" :: held 2.178s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_snapshot" :: held 2.217s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "cinder-f55398d0-a09e-45fc-bc2d-74527573ca26-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Created reservations ['ab08de98-af0d-42af-a602-36a8235ebbfb', 'af2c1c76-2eb6-43c1-a069-04d231a0b434', 'a274d5e5-215a-4ec5-a7d3-3d2b29c8b71b', '8cead15e-19de-43fa-84e8-6fce9b9d20f1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "cinder-f55398d0-a09e-45fc-bc2d-74527573ca26-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "cinder-quobyte-f55398d0-a09e-45fc-bc2d-74527573ca26" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "cinder-quobyte-f55398d0-a09e-45fc-bc2d-74527573ca26" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Delete snapshot completed successfully. Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4480de3a-20be-42fc-8ea4-9c94f3408592]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d6440c21-2ca0-4cb8-9950-c9606084eba4 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-f1737ffd-29e9-4a05-8a6c-b4f81e8155c9-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:56 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 Aug 05 15:53:56 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26" returned: 0 in 0.448s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26 Aug 05 15:53:56 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:57 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f55398d0-a09e-45fc-bc2d-74527573ca26" returned: 0 in 0.289s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "cinder-quobyte-f55398d0-a09e-45fc-bc2d-74527573ca26" released by "delete_volume" :: held 0.805s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Created reservations ['33f50ee7-841a-40ad-b4fd-e31f125be90c', 'dd08e5e6-76a7-4269-8dd7-fc4784bb6401', 'fd5bfa23-a56b-42f4-9bca-5e9814909de9', 'eb9d83f8-44df-4f19-b706-c8375908e675'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:53:57 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fb451032-b283-48c7-af39-a00853fc2d4e tempest-BackendsCapabilitiesAdminTestsJSON-1477971445 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6386604309082, 'free_capacity_gb': 1775.6386604309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88715) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-98be6ade-01f2-4a36-9bc9-a2f1ba2d3881 tempest-BackendsCapabilitiesAdminTestsJSON-1477971445 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6386604309082, 'free_capacity_gb': 1775.6386604309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88715) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Creating offline snapshot 37fed5bc-f171-4a91-ba68-e397f9e334df of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851aa2d-4d83-4d98-9832-656b1e7f9749]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.572s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Deleted volume successfully. Aug 05 15:53:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-71a22035-df38-4a25-af7f-444b4da52db2 tempest-TestServerVolumeAttachScenarioOldVersion-898491080 None] Lock "cinder-f55398d0-a09e-45fc-bc2d-74527573ca26-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:58 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:53:58 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:58 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.536s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:58 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df 1G Aug 05 15:53:58 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df 1G" returned: 0 in 0.946s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:59 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df Aug 05 15:53:59 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df" returned: 0 in 0.455s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df is being set with open permissions: ugo+rw Aug 05 15:53:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:59 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df Aug 05 15:53:59 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:00 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df" returned: 0 in 0.357s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:00 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-04e2dfab-e4da-4fa1-afce-a88794d0f5b5 tempest-SnapshotsActionsTest-475281208 None] Create snapshot completed successfully Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-37fed5bc-f171-4a91-ba68-e397f9e334df-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-37fed5bc-f171-4a91-ba68-e397f9e334df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-37fed5bc-f171-4a91-ba68-e397f9e334df" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-37fed5bc-f171-4a91-ba68-e397f9e334df" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Deleting offline snapshot 37fed5bc-f171-4a91-ba68-e397f9e334df of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] snapshot_file for this snap is: volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3381ff4-7553-48b7-a66a-170a0b2dbf0f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:01 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df Aug 05 15:54:01 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:01 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df" returned: 0 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47473d9-7466-4bc0-a43e-932fa0b96be2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:01 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:01 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:02 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:02 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df Aug 05 15:54:02 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:02 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df" returned: 0 in 0.484s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:02 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df Aug 05 15:54:02 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:02 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.37fed5bc-f171-4a91-ba68-e397f9e334df" returned: 0 in 0.269s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-37fed5bc-f171-4a91-ba68-e397f9e334df" released by "_delete_snapshot" :: held 1.838s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_snapshot" :: held 1.870s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Created reservations ['b064a327-43e2-4c53-aa11-4e327371b553', '99d8f8cd-91a0-4009-9462-52c23da534ed', '783c3421-ca0c-4dc2-88e9-a3716c97906c', '07c72848-4c2e-4290-9c46-7ff091a973f5'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Delete snapshot completed successfully. Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-17e7b387-5af3-48f5-af0e-f75a0f491184 tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-37fed5bc-f171-4a91-ba68-e397f9e334df-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:03 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:03 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Creating offline snapshot 58447429-6431-4fe8-90af-a4c9f4c65ba6 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7897b1-e6ab-43a9-bfdc-6f6ee75e5811]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:03 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:03 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:04 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:54:04 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.461s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:04 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 1G Aug 05 15:54:04 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:04 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 1G" returned: 0 in 0.541s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:04 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 Aug 05 15:54:04 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-aa01246e-6513-4be7-ab48-afef00bc8912 tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-1550178538: creating Aug 05 15:54:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-aa01246e-6513-4be7-ab48-afef00bc8912 tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-1550178538: created successfully Aug 05 15:54:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-aa01246e-6513-4be7-ab48-afef00bc8912 tempest-GroupSnapshotsTest-39649475 None] Create group completed successfully. Aug 05 15:54:05 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:05 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 is being set with open permissions: ugo+rw Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:05 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 Aug 05 15:54:05 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:05 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4d95663b-b25c-4d92-a57f-5aa223003c8c tempest-SnapshotsActionsTest-475281208 None] Create snapshot completed successfully Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-58447429-6431-4fe8-90af-a4c9f4c65ba6-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-58447429-6431-4fe8-90af-a4c9f4c65ba6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Acquiring lock "cinder-quobyte-58447429-6431-4fe8-90af-a4c9f4c65ba6" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-58447429-6431-4fe8-90af-a4c9f4c65ba6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Deleting offline snapshot 58447429-6431-4fe8-90af-a4c9f4c65ba6 of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] snapshot_file for this snap is: volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc363f0-21ac-46ba-969d-1aa6a4c8fafd]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:06 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 Aug 05 15:54:06 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:06 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6" returned: 0 in 0.538s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d167240-4c59-419e-8f78-dfff424d477b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:06 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:06 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (f5ce92a8-588a-4ba2-b72b-b683f9fdcd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54da1fa-feec-48fd-a10b-5985aac5c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54da1fa-feec-48fd-a10b-5985aac5c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883890638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d8ab995-b91e-43b4-a3fc-e25f5be29235,host='devstack@QuobyteHD#QuobyteHD',id=8c8fa056-31aa-48e8-a871-a7f8c2643b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0be7244-e8b9-4282-80de-6335075476b9),volume_type_id=c0be7244-e8b9-4282-80de-6335075476b9)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e550572d-3fad-4bf9-a568-1d3feb51888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e550572d-3fad-4bf9-a568-1d3feb51888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7885d2de-b906-4d93-81dc-947a6b7b2d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7885d2de-b906-4d93-81dc-947a6b7b2d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8fa056-31aa-48e8-a871-a7f8c2643b93', 'volume_name': 'volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8302e5d-a081-4d91-b8f5-82cef620c28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8302e5d-a081-4d91-b8f5-82cef620c28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef609eaa-c5bd-4f65-8f98-50ae50aad73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Volume 8c8fa056-31aa-48e8-a871-a7f8c2643b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93', 'volume_size': 1} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d8ab995-b91e-43b4-a3fc-e25f5be29235,created_at=2026-08-05T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883890638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d8ab995-b91e-43b4-a3fc-e25f5be29235,host='devstack@QuobyteHD#QuobyteHD',id=8c8fa056-31aa-48e8-a871-a7f8c2643b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0be7244-e8b9-4282-80de-6335075476b9),volume_type_id=c0be7244-e8b9-4282-80de-6335075476b9)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Creating volume 8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:07 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 1073741824 Aug 05 15:54:07 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:07 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.527s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 Aug 05 15:54:07 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:07 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6" returned: 0 in 0.571s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6 Aug 05 15:54:07 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:07 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 1073741824" returned: 0 in 0.699s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:07 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:08 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.58447429-6431-4fe8-90af-a4c9f4c65ba6" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-58447429-6431-4fe8-90af-a4c9f4c65ba6" released by "_delete_snapshot" :: held 2.146s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_snapshot" :: held 2.177s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Created reservations ['23c8653b-56ac-44fb-8090-e091d4abccf4', 'f8222fc3-6a12-41ef-b512-9b85b1a90f03', 'ec464f22-94ef-4e8a-98d0-9f3f65216eb9', '839a0882-0410-4866-a637-c9e7f69f9b84'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:08 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.461s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef609eaa-c5bd-4f65-8f98-50ae50aad73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1983758-40fe-4746-98bc-588d4a6aa25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:08 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Volume volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 (8c8fa056-31aa-48e8-a871-a7f8c2643b93): created successfully Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1983758-40fe-4746-98bc-588d4a6aa25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (f5ce92a8-588a-4ba2-b72b-b683f9fdcd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Delete snapshot completed successfully. Aug 05 15:54:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ead9d836-c46f-4cfc-9dbc-57838e6165d2 tempest-GroupSnapshotsTest-39649475 None] Created volume successfully. Aug 05 15:54:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7ef87e9-acfe-4d31-bf0e-8b617da2568b tempest-SnapshotsActionsTest-1472541309 None] Lock "cinder-58447429-6431-4fe8-90af-a4c9f4c65ba6-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "cinder-99c6e41d-dcb2-4f2a-84ea-111326f78d2e-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-99c6e41d-dcb2-4f2a-84ea-111326f78d2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "cinder-quobyte-99c6e41d-dcb2-4f2a-84ea-111326f78d2e" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-99c6e41d-dcb2-4f2a-84ea-111326f78d2e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Deleting offline snapshot 99c6e41d-dcb2-4f2a-84ea-111326f78d2e of volume 16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] snapshot_file for this snap is: volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61dc0ec-e170-47c6-b635-62d80c83ec39]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] GroupSnapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: creating. Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Group snapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: creating. {{(pid=88715) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Creating offline snapshot 2bc546fd-c02c-46cb-ab07-14c4b6a6a71c of volume 8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3fecb6-cdba-4b2d-86aa-f9d2d8f82ae7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:09 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:09 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:10 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.496s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16caae98-c453-4669-a9e2-458e69929273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd035605-4b4f-4c46-88d2-6cab0339c0ed]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c 1G Aug 05 15:54:10 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 Aug 05 15:54:10 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273" returned: 0 in 0.444s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:10 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c 1G" returned: 0 in 0.465s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:10 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.353s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:11 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e Aug 05 15:54:11 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273.99c6e41d-dcb2-4f2a-84ea-111326f78d2e" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-99c6e41d-dcb2-4f2a-84ea-111326f78d2e" released by "_delete_snapshot" :: held 1.759s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_snapshot" :: held 1.788s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:11 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info Aug 05 15:54:11 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Created reservations ['08ccb708-b197-495d-8932-896c33f2709a', 'd90ad377-8515-4792-819f-ab9219e894e6', '0dd10442-b54c-4442-bdd6-8658b23b6538', '52defa8f-14a2-4b18-99eb-b0362f19a7f1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:11 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Delete snapshot completed successfully. Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-918019ad-3a90-4771-83bc-1d145ef4fe77 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-99c6e41d-dcb2-4f2a-84ea-111326f78d2e-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:11 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info" returned: 0 in 0.473s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "cinder-16caae98-c453-4669-a9e2-458e69929273-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:11 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info Aug 05 15:54:11 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-16caae98-c453-4669-a9e2-458e69929273-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[41005913-78e5-4aae-b1d4-373e327ed02a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (9bd32fe8-12b9-40df-be77-e02a771d808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ba49c-f2c4-4b2e-baab-d8fde343b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ba49c-f2c4-4b2e-baab-d8fde343b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-648428979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:12Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273959c8-c56c-4a38-a45c-8b4dfb838015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273959c8-c56c-4a38-a45c-8b4dfb838015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe089786-dee2-48d2-a0b4-56a8cf0577e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:12 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe089786-dee2-48d2-a0b4-56a8cf0577e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1', 'volume_name': 'volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:12 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 Aug 05 15:54:12 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24e1a88-5f42-46aa-8964-e35380203660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24e1a88-5f42-46aa-8964-e35380203660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc18a5e-c06e-4770-92c1-45a7822a4b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Volume f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1', 'volume_size': 1} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.info" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-648428979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:12Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Creating volume f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:12 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 1073741824 Aug 05 15:54:12 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-269f31ba-6130-4855-ada8-87f8f00235d1 tempest-GroupSnapshotsTest-39649475 None] group_snapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: created successfully Aug 05 15:54:12 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273" returned: 0 in 0.451s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273 Aug 05 15:54:12 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-16caae98-c453-4669-a9e2-458e69929273" returned: 0 in 0.320s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-quobyte-16caae98-c453-4669-a9e2-458e69929273" released by "delete_volume" :: held 0.849s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:12 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 1073741824" returned: 0 in 0.625s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Created reservations ['74b27ad8-5899-431b-b2a3-77510659f3ad', '61fd8074-0363-4a0f-896e-670af299834b', '07e0d26f-0b90-4f4d-8b45-a09412e11f77', '03731d21-bf8a-4da6-8dec-b6335c0c0c6b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:13 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 Aug 05 15:54:13 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:13 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" returned: 0 in 0.441s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc18a5e-c06e-4770-92c1-45a7822a4b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d231f4-f5da-4dc9-9c67-ca038463ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Volume volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 (f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1): created successfully Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d231f4-f5da-4dc9-9c67-ca038463ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (9bd32fe8-12b9-40df-be77-e02a771d808f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6b5c91fb-6834-4952-907d-e2cad40cd0f1 tempest-AttachVolumeTestJSON-1654015949 None] Created volume successfully. Aug 05 15:54:13 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.429s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Deleted volume successfully. Aug 05 15:54:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0601ab3e-13f5-4b38-aa62-609227d2ec64 tempest-SnapshotsActionsTest-475281208 None] Lock "cinder-16caae98-c453-4669-a9e2-458e69929273-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c-0e050c16-37e9-4487-a60e-5e19c61d5220" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c-0e050c16-37e9-4487-a60e-5e19c61d5220" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Creating volume 0e050c16-37e9-4487-a60e-5e19c61d5220 from snapshot 2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] snapshot: 2bc546fd-c02c-46cb-ab07-14c4b6a6a71c, volume: 0e050c16-37e9-4487-a60e-5e19c61d5220, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499a10b-2c15-4916-9f57-989f2ce2e7ab]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:14 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:14 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.528s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f065a0c-f6f0-415b-affa-8023e22d876f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:15 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.620s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:54:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 Aug 05 15:54:15 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:21 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220" returned: 0 in 5.827s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceefb63-6157-4d04-a1a2-ae274a2186ea]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:21 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:21 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:21 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.563s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:54:21 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Converted 1024.00 MB image at 175.69 MB/s Aug 05 15:54:21 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:21 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 Aug 05 15:54:21 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220" returned: 0 in 0.283s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" released by "_copy_volume_from_snapshot" :: held 7.967s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c-0e050c16-37e9-4487-a60e-5e19c61d5220" released by "_create_volume_from_snapshot" :: held 8.014s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.056s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.475s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8844950d-0f25-4b52-a1b6-3d46c12bd208]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4c9295fe-00f9-4a37-a262-1c210f9aca4b tempest-GroupSnapshotsTest-39649475 None] Create group from source-snapshot-334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34 completed successfully. Aug 05 15:54:22 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 Aug 05 15:54:22 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" returned: 0 in 0.486s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.511s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '483eb133-9f99-4299-aa93-56305f01018e', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:54:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-923afe67-9a45-4ba4-afba-1ffb74114a74 req-214ddfb7-1ff2-4138-977d-6374bcdfee96 tempest-AttachVolumeTestJSON-1654015949 None] attachment_update completed successfully. Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[809c9246-0e35-4871-9f24-f20d663fd2c9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:23 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 Aug 05 15:54:23 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:23 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220" returned: 0 in 0.579s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:23 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220 Aug 05 15:54:23 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:24 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0e050c16-37e9-4487-a60e-5e19c61d5220" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-0e050c16-37e9-4487-a60e-5e19c61d5220" released by "delete_volume" :: held 0.956s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Created reservations ['e72e1218-3585-421a-afac-7b714f057285'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:24 devstack cinder-volume[88715]: WARNING cinder.quota [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1168818630 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1168818630, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:24 devstack cinder-volume[88715]: WARNING cinder.quota [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1168818630 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1168818630, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Created reservations ['f6a9131c-d0be-4d26-a8ad-a2bbd935aea4', '8d6a596b-80b7-4883-a753-d5a67e7c6b77', 'ec7ae78d-713b-4b92-858a-46ae27ca9ebe', 'da58eb12-33e2-4026-bdcf-c140da4301ea'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=117,cinder:UPDATE=116,cinder:INSERT=28,cinder:DELETE=7 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:24 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:24 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Flow 'volume_create_manager' (a45b6c81-6106-4d32-91b6-3685ee80301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486f64f5-5cb3-476f-976a-9d773c8a5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=118,cinder:UPDATE=109,cinder:INSERT=27,cinder:DELETE=9 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:54:24 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.319s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486f64f5-5cb3-476f-976a-9d773c8a5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1387756793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e61a911-607e-4a39-8437-1825733d5e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f3f2f627204263a3fda37fb9b929f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:25Z,use_quota=True,user_id='ecd165d87eae4d179967f3a66f5d2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed1b9f2-d43d-4b49-81a3-ff69d83b4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed1b9f2-d43d-4b49-81a3-ff69d83b4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ce97a4-f434-47df-a567-7ddafb7e97a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ce97a4-f434-47df-a567-7ddafb7e97a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e61a911-607e-4a39-8437-1825733d5e6f', 'volume_name': 'volume-9e61a911-607e-4a39-8437-1825733d5e6f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49eb4e8-a431-43a7-ad4f-815b10bc59b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49eb4e8-a431-43a7-ad4f-815b10bc59b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0662d-d41e-43fd-b738-d1bf6436aa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume 9e61a911-607e-4a39-8437-1825733d5e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e61a911-607e-4a39-8437-1825733d5e6f', 'volume_size': 1} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1387756793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e61a911-607e-4a39-8437-1825733d5e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f3f2f627204263a3fda37fb9b929f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:25Z,use_quota=True,user_id='ecd165d87eae4d179967f3a66f5d2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Creating volume 9e61a911-607e-4a39-8437-1825733d5e6f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:24 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e3b2369b-fd00-448e-9bd1-b6064097c53a tempest-GroupSnapshotsTest-39649475 None] Delete group completed successfully. Aug 05 15:54:25 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f 1073741824 Aug 05 15:54:25 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:25 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f 1073741824" returned: 0 in 0.658s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:25 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f Aug 05 15:54:25 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] group_snapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: deleting Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] group_snapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: deleting {{(pid=88715) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (172070bb-954c-4fe3-9a85-731d9e337715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b4a6c-b9a1-46a1-9d9c-0a2c7b8e579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f" returned: 0 in 0.307s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b4a6c-b9a1-46a1-9d9c-0a2c7b8e579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1584389402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1dd622-a985-42d3-a731-22cc906be8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:26Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228dcf7d-0a91-467d-8e0c-fef59e1313ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228dcf7d-0a91-467d-8e0c-fef59e1313ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7958f08e-0416-43c8-b093-27c2b9ab34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7958f08e-0416-43c8-b093-27c2b9ab34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1dd622-a985-42d3-a731-22cc906be8b3', 'volume_name': 'volume-0f1dd622-a985-42d3-a731-22cc906be8b3', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8de11d-2ffc-4399-adf9-437489708a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8de11d-2ffc-4399-adf9-437489708a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ade044e-f127-4b2f-9c45-b2fbc1920076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Volume 0f1dd622-a985-42d3-a731-22cc906be8b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1dd622-a985-42d3-a731-22cc906be8b3', 'volume_size': 1} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1584389402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1dd622-a985-42d3-a731-22cc906be8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70d249990a441b39746ee4d462c9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:26Z,use_quota=True,user_id='48d13777178f469c996bd0a0dcb4f6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Creating volume 0f1dd622-a985-42d3-a731-22cc906be8b3 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:26 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 1073741824 Aug 05 15:54:26 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0662d-d41e-43fd-b738-d1bf6436aa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e61a911-607e-4a39-8437-1825733d5e6f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9175d7-84ca-48bc-8720-6cec10875cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" acquired by "delete_snapshot" :: waited 0.153s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume volume-9e61a911-607e-4a39-8437-1825733d5e6f (9e61a911-607e-4a39-8437-1825733d5e6f): created successfully Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9175d7-84ca-48bc-8720-6cec10875cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Flow 'volume_create_manager' (a45b6c81-6106-4d32-91b6-3685ee80301e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Deleting offline snapshot 2bc546fd-c02c-46cb-ab07-14c4b6a6a71c of volume 8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] snapshot_file for this snap is: volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3f5ef346-9206-4e65-9a31-0fb32b8862b0 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Created volume successfully. Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c334102-1626-4b79-a5bd-42f2020815d3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:26 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 1073741824" returned: 0 in 0.508s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.429s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:26 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 Aug 05 15:54:26 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[af268ce5-e826-4c5f-8327-5dcc410c214c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:26 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3" returned: 0 in 0.327s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ade044e-f127-4b2f-9c45-b2fbc1920076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1dd622-a985-42d3-a731-22cc906be8b3', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19394011-3c52-402f-9c65-af1c7936b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Volume volume-0f1dd622-a985-42d3-a731-22cc906be8b3 (0f1dd622-a985-42d3-a731-22cc906be8b3): created successfully Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19394011-3c52-402f-9c65-af1c7936b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Flow 'volume_create_manager' (172070bb-954c-4fe3-9a85-731d9e337715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-886ca513-6cd2-4bc3-8027-7e0d972afbdb tempest-AttachVolumeTestJSON-1654015949 None] Created volume successfully. Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "cinder-9e61a911-607e-4a39-8437-1825733d5e6f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "cinder-9e61a911-607e-4a39-8437-1825733d5e6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:27 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.502s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "cinder-quobyte-9e61a911-607e-4a39-8437-1825733d5e6f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:27 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:27 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "cinder-quobyte-9e61a911-607e-4a39-8437-1825733d5e6f" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b744fce-79dc-4bfb-bfbb-ce2efc4c53f7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f Aug 05 15:54:27 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.376s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c Aug 05 15:54:27 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f" returned: 0 in 0.415s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f Aug 05 15:54:27 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93.2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-2bc546fd-c02c-46cb-ab07-14c4b6a6a71c" released by "_delete_snapshot" :: held 1.736s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" released by "delete_snapshot" :: held 1.799s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:28 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e61a911-607e-4a39-8437-1825733d5e6f" returned: 0 in 0.335s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "cinder-quobyte-9e61a911-607e-4a39-8437-1825733d5e6f" released by "delete_volume" :: held 0.801s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:28 devstack cinder-volume[88715]: WARNING cinder.quota [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1168818630 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1168818630, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] Created reservations ['36c4630a-a4bf-487d-95db-87a6ddff6c11', '30ce691b-2144-443f-8b12-e83135e9ae97', 'b195a635-d32c-4721-b039-26a35bf99088', 'bbe24424-fe2a-4e7e-92bd-eb1a1a43f435'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Created reservations ['549f5705-d78c-4157-954c-f07ee4f167b8', '26850409-110b-44ee-8f51-dd7eeaaa938d', 'a98f8071-58e9-4237-88fd-3358891da3ce', 'fd4edd03-54f8-42dc-aa90-11d3ef69b1e4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-59548d12-afad-4f50-8ed2-b0d52fc60fdd tempest-GroupSnapshotsTest-39649475 None] group_snapshot 334f66b2-6bbf-4b84-8eb1-2c21cb4e9f34: deleted successfully Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:28 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:28 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:28 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.445s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Deleted volume successfully. Aug 05 15:54:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90612807-9b48-410b-9b65-c9fc03e3f5f9 tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "cinder-9e61a911-607e-4a39-8437-1825733d5e6f-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e1e377-b538-406a-86ae-fb3e338ddf49]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Flow 'volume_create_manager' (da07387d-0e78-400b-9456-0e17436fdb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d912d34c-8932-4e35-8654-d9ac972db60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d912d34c-8932-4e35-8654-d9ac972db60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-971458045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c459fe-cec6-4746-8bf0-b5801f063d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f3f2f627204263a3fda37fb9b929f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:29Z,use_quota=True,user_id='ecd165d87eae4d179967f3a66f5d2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1f0aca-894a-43ec-a0d1-c7614661ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:29 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 Aug 05 15:54:29 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1f0aca-894a-43ec-a0d1-c7614661ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307e00c0-4c46-4677-9c3a-0b4dc87cddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307e00c0-4c46-4677-9c3a-0b4dc87cddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c459fe-cec6-4746-8bf0-b5801f063d22', 'volume_name': 'volume-12c459fe-cec6-4746-8bf0-b5801f063d22', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb4da45-90aa-4064-aab7-ebf70549d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb4da45-90aa-4064-aab7-ebf70549d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce8cd28-3c9d-4eab-9296-b7ac2c38d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume 12c459fe-cec6-4746-8bf0-b5801f063d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c459fe-cec6-4746-8bf0-b5801f063d22', 'volume_size': 1} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:29 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3" returned: 0 in 0.399s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.426s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.239s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-971458045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c459fe-cec6-4746-8bf0-b5801f063d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f3f2f627204263a3fda37fb9b929f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:29Z,use_quota=True,user_id='ecd165d87eae4d179967f3a66f5d2db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Creating volume 12c459fe-cec6-4746-8bf0-b5801f063d22 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:29 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:29 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 1073741824 Aug 05 15:54:29 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-0f1dd622-a985-42d3-a731-22cc906be8b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53c34d74-2fbc-4d8e-9f96-33e57d5153a2', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-4487f06f-e961-40df-8fb7-4a0998ed42c5 req-0c2e2e07-877d-4fdd-bdab-9349d8ea1e29 tempest-AttachVolumeTestJSON-1654015949 None] attachment_update completed successfully. Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e4762-ee6d-4951-adca-e1f2a0fb7c1c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:29 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:29 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:30 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 1073741824" returned: 0 in 0.600s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:30 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 Aug 05 15:54:30 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:30 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.514s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:30 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93 Aug 05 15:54:30 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:30 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:30 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce8cd28-3c9d-4eab-9296-b7ac2c38d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c459fe-cec6-4746-8bf0-b5801f063d22', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28789d5b-2d71-4d81-9ba5-f3da331a1fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8c8fa056-31aa-48e8-a871-a7f8c2643b93" returned: 0 in 0.376s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-8c8fa056-31aa-48e8-a871-a7f8c2643b93" released by "delete_volume" :: held 0.979s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Volume volume-12c459fe-cec6-4746-8bf0-b5801f063d22 (12c459fe-cec6-4746-8bf0-b5801f063d22): created successfully Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28789d5b-2d71-4d81-9ba5-f3da331a1fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Flow 'volume_create_manager' (da07387d-0e78-400b-9456-0e17436fdb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f75d744b-ee67-436b-8a65-156c19229f0b tempest-VolumeQuotasAdminTestJSON-1299351241 None] Created volume successfully. Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['530243a6-a57c-41cc-9304-e0a1abda18db'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:30 devstack cinder-volume[88715]: WARNING cinder.db.api [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1168818630'] Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['03287d3f-1dbe-47e4-925a-d0a3de6a72ad', 'da9786f8-c5ae-4aa8-b91c-98bc55723c96', 'e3fc931c-fbb7-41a1-ad7e-0aae75f357c7', 'cfd8b76d-b3bf-4218-9b9a-c1c69f5c4bf5'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:30 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:30 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:31 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:31 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7c0affd8-c22f-4966-a57a-8de850d76fd9 tempest-GroupSnapshotsTest-39649475 None] Delete group completed successfully. Aug 05 15:54:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c87549f1-fe2a-43d2-8fb7-09eeb07b647f tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-994083425: creating Aug 05 15:54:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c87549f1-fe2a-43d2-8fb7-09eeb07b647f tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-994083425: created successfully Aug 05 15:54:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c87549f1-fe2a-43d2-8fb7-09eeb07b647f tempest-GroupSnapshotsTest-39649475 None] Create group completed successfully. Aug 05 15:54:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5b209d8e-9aa6-46a6-bcbe-6fcddd378697 tempest-VolumeQuotasAdminTestJSON-2134289478 None] Transfer volume completed successfully. Aug 05 15:54:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-318964fb-2305-47e0-b750-0fd82ab3c0f0 req-6c039728-776e-4a55-8d9a-b4a66ede7a3a tempest-AttachVolumeTestJSON-1654015949 None] Terminate volume connection completed successfully. Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-318964fb-2305-47e0-b750-0fd82ab3c0f0 req-6c039728-776e-4a55-8d9a-b4a66ede7a3a tempest-AttachVolumeTestJSON-1654015949 None] Deleting attachment 483eb133-9f99-4299-aa93-56305f01018e. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Acquiring lock "cinder-12c459fe-cec6-4746-8bf0-b5801f063d22-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "cinder-12c459fe-cec6-4746-8bf0-b5801f063d22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Acquiring lock "cinder-quobyte-12c459fe-cec6-4746-8bf0-b5801f063d22" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "cinder-quobyte-12c459fe-cec6-4746-8bf0-b5801f063d22" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f7178-c3f5-4ad2-89d4-fbd60321c8c0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:33 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 Aug 05 15:54:33 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:33 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (7fcd03db-7c49-4657-8516-50b8b3975bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726c922f-e50c-4df3-9d74-de15c8514cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22" returned: 0 in 0.651s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726c922f-e50c-4df3-9d74-de15c8514cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751200498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c391cdfb-6cc9-44c9-9291-b313520808c9,host='devstack@QuobyteHD#QuobyteHD',id=6db45ed0-f91c-4bbb-b03f-33c768b9ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:34Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb49c50-f98f-4fce-b82d-484bb4d70bd3),volume_type_id=6eb49c50-f98f-4fce-b82d-484bb4d70bd3)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb15fa5-e9b7-498f-b480-e946743c454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22 Aug 05 15:54:33 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb15fa5-e9b7-498f-b480-e946743c454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9ebfa5-a04f-4d77-90d9-0ba39aa459db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9ebfa5-a04f-4d77-90d9-0ba39aa459db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db45ed0-f91c-4bbb-b03f-33c768b9ffe8', 'volume_name': 'volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ae13e-05cb-4b0b-a22e-5e4a4dc70a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ae13e-05cb-4b0b-a22e-5e4a4dc70a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c14cd-4a0f-4982-a3f0-41f50f92c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Volume 6db45ed0-f91c-4bbb-b03f-33c768b9ffe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8', 'volume_size': 1} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c391cdfb-6cc9-44c9-9291-b313520808c9,created_at=2026-08-05T13:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751200498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c391cdfb-6cc9-44c9-9291-b313520808c9,host='devstack@QuobyteHD#QuobyteHD',id=6db45ed0-f91c-4bbb-b03f-33c768b9ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:34Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb49c50-f98f-4fce-b82d-484bb4d70bd3),volume_type_id=6eb49c50-f98f-4fce-b82d-484bb4d70bd3)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Creating volume 6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:33 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:33 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 1073741824 Aug 05 15:54:33 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:33 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12c459fe-cec6-4746-8bf0-b5801f063d22" returned: 0 in 0.344s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "cinder-quobyte-12c459fe-cec6-4746-8bf0-b5801f063d22" released by "delete_volume" :: held 1.061s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Created reservations ['fba875b4-b369-4edb-9488-63fe0ed9fc58', '114e8e87-6cc9-4696-8c21-b24295f09791', 'f3a556bf-d2b0-4f52-a9a8-eac29d299c5d', 'd55ff7b6-e224-45d3-8827-494530e4eaf7'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-c7da22ad-3df1-4871-afc6-ac6bc657fa55 req-ade6402e-b2b5-4c13-b5fa-3b4422ddbbbf tempest-AttachVolumeTestJSON-1654015949 None] Terminate volume connection completed successfully. Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-c7da22ad-3df1-4871-afc6-ac6bc657fa55 req-ade6402e-b2b5-4c13-b5fa-3b4422ddbbbf tempest-AttachVolumeTestJSON-1654015949 None] Deleting attachment 53c34d74-2fbc-4d8e-9f96-33e57d5153a2. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:34 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:34 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:34 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 1073741824" returned: 0 in 0.661s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:34 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 Aug 05 15:54:34 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:34 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Deleted volume successfully. Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-38a9b0d3-4006-46a2-9cbc-f1ff1c9d03fb tempest-VolumeQuotasAdminTestJSON-762762903 None] Lock "cinder-12c459fe-cec6-4746-8bf0-b5801f063d22-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:34 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" returned: 0 in 0.315s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c14cd-4a0f-4982-a3f0-41f50f92c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb23ca68-3e36-4784-b6f9-dcc3c86e9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Volume volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 (6db45ed0-f91c-4bbb-b03f-33c768b9ffe8): created successfully Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb23ca68-3e36-4784-b6f9-dcc3c86e9b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (7fcd03db-7c49-4657-8516-50b8b3975bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-515ec320-b312-4eaa-b030-377bb65503c1 tempest-GroupSnapshotsTest-39649475 None] Created volume successfully. Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (fb9cbfaa-871c-4c6e-9801-d69be9048eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed318172-9d52-4d48-8a83-0ea2cbf2d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed318172-9d52-4d48-8a83-0ea2cbf2d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208383434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c391cdfb-6cc9-44c9-9291-b313520808c9,host='devstack@QuobyteHD#QuobyteHD',id=7007c9c9-1aac-445b-b104-1515eeaf557f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:37Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb49c50-f98f-4fce-b82d-484bb4d70bd3),volume_type_id=6eb49c50-f98f-4fce-b82d-484bb4d70bd3)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde9ba39-c969-4049-aa15-8be3209ef7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde9ba39-c969-4049-aa15-8be3209ef7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297e6160-2f31-4b8b-80a1-a8196f7da4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297e6160-2f31-4b8b-80a1-a8196f7da4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7007c9c9-1aac-445b-b104-1515eeaf557f', 'volume_name': 'volume-7007c9c9-1aac-445b-b104-1515eeaf557f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2835cf-cbfc-4b9a-934c-6e1db02afd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2835cf-cbfc-4b9a-934c-6e1db02afd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3877f8c-8d44-41aa-b487-647790416985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:37 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Volume 7007c9c9-1aac-445b-b104-1515eeaf557f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7007c9c9-1aac-445b-b104-1515eeaf557f', 'volume_size': 1} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c391cdfb-6cc9-44c9-9291-b313520808c9,created_at=2026-08-05T13:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208383434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c391cdfb-6cc9-44c9-9291-b313520808c9,host='devstack@QuobyteHD#QuobyteHD',id=7007c9c9-1aac-445b-b104-1515eeaf557f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:37Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb49c50-f98f-4fce-b82d-484bb4d70bd3),volume_type_id=6eb49c50-f98f-4fce-b82d-484bb4d70bd3)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Creating volume 7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:37 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:37 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f 1073741824 Aug 05 15:54:37 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:37 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f 1073741824" returned: 0 in 0.642s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:38 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f Aug 05 15:54:38 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:38 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3877f8c-8d44-41aa-b487-647790416985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7007c9c9-1aac-445b-b104-1515eeaf557f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c04d58a-2400-49ee-8216-723d6ac9ed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Volume volume-7007c9c9-1aac-445b-b104-1515eeaf557f (7007c9c9-1aac-445b-b104-1515eeaf557f): created successfully Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c04d58a-2400-49ee-8216-723d6ac9ed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (fb9cbfaa-871c-4c6e-9801-d69be9048eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cad34e41-2aab-49d4-89b8-3a1bc1938c29 tempest-GroupSnapshotsTest-39649475 None] Created volume successfully. Aug 05 15:54:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2469d54d-5ec0-4ec7-9f1a-be6df9ec9e98 tempest-GroupSnapshotsTest-39649475 None] Update group completed successfully. Aug 05 15:54:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-eecbe3c0-48c2-42f2-841a-ac8a0646bfcf tempest-GroupSnapshotsTest-39649475 None] Update group completed successfully. Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-0f1dd622-a985-42d3-a731-22cc906be8b3-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-0f1dd622-a985-42d3-a731-22cc906be8b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-quobyte-0f1dd622-a985-42d3-a731-22cc906be8b3" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-0f1dd622-a985-42d3-a731-22cc906be8b3" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e5677-6614-4458-bd96-1acb38e889c0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:40 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 Aug 05 15:54:40 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3" returned: 0 in 0.477s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3 Aug 05 15:54:41 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4711e237-7d18-456c-ae14-66b8b732fc83 tempest-GroupSnapshotsTest-39649475 None] Update group completed successfully. Aug 05 15:54:41 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f1dd622-a985-42d3-a731-22cc906be8b3" returned: 0 in 0.395s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-0f1dd622-a985-42d3-a731-22cc906be8b3" released by "delete_volume" :: held 0.952s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Created reservations ['38265def-cc26-432d-912d-4717a6eac396', 'bf41921f-f81a-45ad-b433-97ee7de8a5f2', '413ee457-5fc3-418d-bd89-318f34aaa338', '00be1519-397c-4d07-a561-158f772d30e7'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:41 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:42 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.289s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:42 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Deleted volume successfully. Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da71a6cf-c06b-4317-bfd1-16e6a472138c tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-0f1dd622-a985-42d3-a731-22cc906be8b3-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:42 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-00678407-9a3e-42cf-ab25-85f0691cab2e tempest-GroupSnapshotsTest-39649475 None] Update group completed successfully. Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-quobyte-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108e644-8e59-4c01-8033-2686c7978e8d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:43 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 Aug 05 15:54:43 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:43 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" returned: 0 in 0.492s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:43 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1 Aug 05 15:54:43 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:43 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1" released by "delete_volume" :: held 0.968s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Created reservations ['6bfed1f9-20f6-4482-8ea5-2c40d5737965', 'c933ce77-4664-4b26-b005-fe6d2ff4e7d0', 'ca17293b-1cf6-476a-b540-82e878af4824', 'ed3a7415-8159-4d69-bc61-4adefb47df24'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:44 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:44 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] GroupSnapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: creating. Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Group snapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: creating. {{(pid=88715) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:44 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Deleted volume successfully. Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Creating offline snapshot 17a75933-acc9-4d78-a3dc-2ad703bc4613 of volume 6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05c4ee-be18-4583-aa10-4173a3662e5f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a7de12f6-8fee-4245-b511-537bca012f93 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-f3c939ff-7ed6-46c6-a89c-c3d060c3e7b1-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:44 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 Aug 05 15:54:44 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:45 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Flow 'volume_create_manager' (bb822212-2f69-43eb-a540-76544ba9a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504c7641-9fe9-47a2-801f-03ae259fc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504c7641-9fe9-47a2-801f-03ae259fc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1204962542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad92f04c-7a5e-4ac0-8286-5061d2daed43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8697d639e4ca44c2be347688c8031fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:45Z,use_quota=True,user_id='865b2f8ed85d4fb4bed19123e14691e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f185b67d-14c0-4f2f-9bad-4dc5874218ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f185b67d-14c0-4f2f-9bad-4dc5874218ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:45 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 1G Aug 05 15:54:45 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925d3920-3234-4ebb-8f73-6cd222859ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925d3920-3234-4ebb-8f73-6cd222859ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad92f04c-7a5e-4ac0-8286-5061d2daed43', 'volume_name': 'volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c92de9-a902-4b70-9a74-84da4072e066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c92de9-a902-4b70-9a74-84da4072e066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd464f-b9f3-469a-8000-33ed75d33124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:45 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Volume ad92f04c-7a5e-4ac0-8286-5061d2daed43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43', 'volume_size': 1} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-a8b3e721-3e10-4362-abe7-2cffb3761c24-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-a8b3e721-3e10-4362-abe7-2cffb3761c24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "cinder-quobyte-a8b3e721-3e10-4362-abe7-2cffb3761c24" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-a8b3e721-3e10-4362-abe7-2cffb3761c24" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6613fba-e732-4420-81d1-f84057098990]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 Aug 05 15:54:45 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 1G" returned: 0 in 0.526s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 Aug 05 15:54:45 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24" returned: 0 in 0.484s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24 Aug 05 15:54:45 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 Aug 05 15:54:46 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a8b3e721-3e10-4362-abe7-2cffb3761c24" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-quobyte-a8b3e721-3e10-4362-abe7-2cffb3761c24" released by "delete_volume" :: held 0.824s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Created reservations ['d9f74b1e-8fdd-4f6b-b3a7-9315241345f6', '1fa9ce7c-2968-4a48-8138-de22167ced8b', '1f646934-2d8d-4ecf-a0e6-69ac14a40bcc', '930e1fe7-639f-4526-a008-678419466e55'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:46 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info Aug 05 15:54:46 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Deleted volume successfully. Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2d55fe1b-2a1f-4ea4-9d3d-bad129e603c6 tempest-AttachVolumeTestJSON-1654015949 None] Lock "cinder-a8b3e721-3e10-4362-abe7-2cffb3761c24-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:46 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info Aug 05 15:54:46 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:47 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.info" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Creating offline snapshot 55c8fc09-4c1c-4890-966d-6edb378ef8ce of volume 7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1816c3ce-5d0f-4da2-a49a-c23ba47e57a0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:47 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f Aug 05 15:54:47 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:47 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:47 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce 1G Aug 05 15:54:47 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce 1G" returned: 0 in 0.510s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7007c9c9-1aac-445b-b104-1515eeaf557f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:48 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7007c9c9-1aac-445b-b104-1515eeaf557f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce Aug 05 15:54:48 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7007c9c9-1aac-445b-b104-1515eeaf557f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce" returned: 0 in 0.440s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:48 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:48 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce Aug 05 15:54:48 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Flow 'volume_create_manager' (78028fec-4c4e-4f11-9865-5e9f9e422743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8bff78-8a4d-41d9-ac58-3380ca422873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8bff78-8a4d-41d9-ac58-3380ca422873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1213700213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd1a539-c13d-4207-b871-8b5159e6948f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8164916534e95b712be4b9e1dd646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:49Z,use_quota=True,user_id='cd2db74e64444d07beae9a85fc070243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91667a4-b761-4f0d-bab9-10b0825f84e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91667a4-b761-4f0d-bab9-10b0825f84e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a6d47-f7c8-4349-8d5f-5cb1c2354a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a6d47-f7c8-4349-8d5f-5cb1c2354a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd1a539-c13d-4207-b871-8b5159e6948f', 'volume_name': 'volume-0dd1a539-c13d-4207-b871-8b5159e6948f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a9c774-264f-4d83-b88c-0dc030725e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a9c774-264f-4d83-b88c-0dc030725e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f20bfa4-b100-48e3-9f44-dd95ba2e27ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume 0dd1a539-c13d-4207-b871-8b5159e6948f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd1a539-c13d-4207-b871-8b5159e6948f', 'volume_size': 1} Aug 05 15:54:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:49 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce" returned: 0 in 0.326s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:49 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info Aug 05 15:54:49 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Flow 'volume_create_manager' (fe6df7a1-a244-452b-831b-8369608262f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac11330-3bd2-410f-b6c8-e67ce7f4b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac11330-3bd2-410f-b6c8-e67ce7f4b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1741779301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3fc37b-914a-4169-95b3-d5c1412cb4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8164916534e95b712be4b9e1dd646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:49Z,use_quota=True,user_id='cd2db74e64444d07beae9a85fc070243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1b7558-49fd-4f20-a414-b964d567ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1b7558-49fd-4f20-a414-b964d567ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b4d401-be49-49bd-99e0-4ee2406a282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b4d401-be49-49bd-99e0-4ee2406a282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3fc37b-914a-4169-95b3-d5c1412cb4ae', 'volume_name': 'volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30fdf56-2fbf-459d-9423-585ba29aaecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30fdf56-2fbf-459d-9423-585ba29aaecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c084b8cd-070b-40f3-9773-2efe06426ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume 8a3fc37b-914a-4169-95b3-d5c1412cb4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae', 'volume_size': 1} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:49 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info" returned: 0 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:49 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:49 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info Aug 05 15:54:49 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:49 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.info" returned: 0 in 0.265s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.414s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1204962542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad92f04c-7a5e-4ac0-8286-5061d2daed43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8697d639e4ca44c2be347688c8031fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:45Z,use_quota=True,user_id='865b2f8ed85d4fb4bed19123e14691e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Creating volume ad92f04c-7a5e-4ac0-8286-5061d2daed43 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:49 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:49 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 1073741824 Aug 05 15:54:49 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-29a163c2-69ee-4af0-a36a-c820a11538ea tempest-GroupSnapshotsTest-39649475 None] group_snapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: created successfully Aug 05 15:54:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] group_snapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: deleting Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] group_snapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: deleting {{(pid=88715) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-17a75933-acc9-4d78-a3dc-2ad703bc4613" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-17a75933-acc9-4d78-a3dc-2ad703bc4613" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Deleting offline snapshot 17a75933-acc9-4d78-a3dc-2ad703bc4613 of volume 6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] snapshot_file for this snap is: volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04a85b-22b5-4185-96f6-d9c88d0e94fe]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 1073741824" returned: 0 in 0.626s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 Aug 05 15:54:50 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 Aug 05 15:54:50 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4762b0-a236-40f7-8aa9-aea023eb9d52]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1213700213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd1a539-c13d-4207-b871-8b5159e6948f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8164916534e95b712be4b9e1dd646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:49Z,use_quota=True,user_id='cd2db74e64444d07beae9a85fc070243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Creating volume 0dd1a539-c13d-4207-b871-8b5159e6948f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:50 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd464f-b9f3-469a-8000-33ed75d33124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd48b77-b82e-4972-8c17-78633b5c1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:50 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f 1073741824 Aug 05 15:54:50 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Volume volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 (ad92f04c-7a5e-4ac0-8286-5061d2daed43): created successfully Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd48b77-b82e-4972-8c17-78633b5c1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:50 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 Aug 05 15:54:50 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Flow 'volume_create_manager' (bb822212-2f69-43eb-a540-76544ba9a986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3f44c8f8-cc34-4d1d-a23f-8b1fb950c6a3 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Created volume successfully. Aug 05 15:54:51 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" returned: 0 in 0.561s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 Aug 05 15:54:51 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f 1073741824" returned: 0 in 0.696s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f Aug 05 15:54:51 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613" returned: 0 in 0.535s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f" returned: 0 in 0.373s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613 Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:51 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.694s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1741779301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3fc37b-914a-4169-95b3-d5c1412cb4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8164916534e95b712be4b9e1dd646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:49Z,use_quota=True,user_id='cd2db74e64444d07beae9a85fc070243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Creating volume 8a3fc37b-914a-4169-95b3-d5c1412cb4ae {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:54:51 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:54:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae 1073741824 Aug 05 15:54:52 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f20bfa4-b100-48e3-9f44-dd95ba2e27ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd1a539-c13d-4207-b871-8b5159e6948f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8660ff54-5354-49d6-8eea-4dcd7c1d7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume volume-0dd1a539-c13d-4207-b871-8b5159e6948f (0dd1a539-c13d-4207-b871-8b5159e6948f): created successfully Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8660ff54-5354-49d6-8eea-4dcd7c1d7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Flow 'volume_create_manager' (78028fec-4c4e-4f11-9865-5e9f9e422743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-97b48443-e0d0-4410-93a6-fe8ab00ab362 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Created volume successfully. Aug 05 15:54:52 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8.17a75933-acc9-4d78-a3dc-2ad703bc4613" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-17a75933-acc9-4d78-a3dc-2ad703bc4613" released by "_delete_snapshot" :: held 2.051s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" released by "delete_snapshot" :: held 2.084s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-55c8fc09-4c1c-4890-966d-6edb378ef8ce" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-55c8fc09-4c1c-4890-966d-6edb378ef8ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Deleting offline snapshot 55c8fc09-4c1c-4890-966d-6edb378ef8ce of volume 7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] snapshot_file for this snap is: volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1fca7a-31b7-4824-8829-a24a4b463fce]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce Aug 05 15:54:52 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:52 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae 1073741824" returned: 0 in 0.741s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae Aug 05 15:54:52 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce" returned: 0 in 0.640s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7007c9c9-1aac-445b-b104-1515eeaf557f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:53 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" returned: 0 in 0.373s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af98f70-9717-438a-9223-c8d6cece8cb4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c084b8cd-070b-40f3-9773-2efe06426ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fd2f5d-5bc4-446f-ba97-ff3e93f48836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Acquiring lock "cinder-ad92f04c-7a5e-4ac0-8286-5061d2daed43-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "cinder-ad92f04c-7a5e-4ac0-8286-5061d2daed43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Volume volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae (8a3fc37b-914a-4169-95b3-d5c1412cb4ae): created successfully Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fd2f5d-5bc4-446f-ba97-ff3e93f48836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Flow 'volume_create_manager' (fe6df7a1-a244-452b-831b-8369608262f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:53 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f Aug 05 15:54:53 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-97dd03fe-e58e-4639-a6a9-9fd1bdaf7ec1 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Created volume successfully. Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Acquiring lock "cinder-quobyte-ad92f04c-7a5e-4ac0-8286-5061d2daed43" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "cinder-quobyte-ad92f04c-7a5e-4ac0-8286-5061d2daed43" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa663e4-7f97-488e-9d4f-a63310e60aee]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 Aug 05 15:54:53 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f" returned: 0 in 0.551s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce Aug 05 15:54:53 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43" returned: 0 in 0.552s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43 Aug 05 15:54:54 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce" returned: 0 in 0.542s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce Aug 05 15:54:54 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ad92f04c-7a5e-4ac0-8286-5061d2daed43" returned: 0 in 0.347s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "cinder-quobyte-ad92f04c-7a5e-4ac0-8286-5061d2daed43" released by "delete_volume" :: held 0.955s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Created reservations ['077f3645-e007-4285-b3a1-384def9bf589', '9e72ac8d-138e-4457-8131-d1531959939e', '290e1fd4-dbe0-4b4e-978a-4d28dd2fb117', '23507bf6-4bc1-4acb-ac3f-a53397d54a77'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:54 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f.55c8fc09-4c1c-4890-966d-6edb378ef8ce" returned: 0 in 0.329s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-55c8fc09-4c1c-4890-966d-6edb378ef8ce" released by "_delete_snapshot" :: held 2.216s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" released by "delete_snapshot" :: held 2.253s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:54 devstack cinder-volume[88715]: WARNING cinder.quota [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1505537351 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1505537351, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:54 devstack cinder-volume[88715]: WARNING cinder.quota [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1505537351 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1505537351, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:54 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.344s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Deleted volume successfully. Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Created reservations ['22f1ddd1-ae9d-42cc-9e83-59b76dd79841', '53c4ea76-7799-4ee2-9171-2298ed5c7447', 'e1b53d76-dc13-4848-96f0-fb1c067a9e16', 'ad610b0f-8534-4118-9705-fd11f473e7a9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-4abbe976-4526-48c7-8b70-2af41fb29c01 tempest-VolumeQuotasNegativeTestJSON-1487939373 None] Lock "cinder-ad92f04c-7a5e-4ac0-8286-5061d2daed43-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] Created reservations ['07b5df2f-8bed-49ed-acc8-367f3c526095', 'eeaf4abd-72b8-4676-af02-3178b32131f4', '7b9e20f4-c3ee-45a4-8fca-15c41c2534e5', 'f6094ed4-cead-4fea-b9d4-0c4934830f2e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d26286a6-a95c-405c-a129-42cffa4ad4ec tempest-GroupSnapshotsTest-39649475 None] group_snapshot f6b1195c-c1bd-4b03-84ca-cc01b330dd30: deleted successfully Aug 05 15:54:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f821b-a3e3-4068-9a8d-d748f683b2c7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 Aug 05 15:54:56 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" returned: 0 in 0.590s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8 Aug 05 15:54:57 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" returned: 0 in 0.326s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-6db45ed0-f91c-4bbb-b03f-33c768b9ffe8" released by "delete_volume" :: held 1.027s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" acquired by "delete_volume" :: waited 0.040s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c948cc4b-db7c-4dbd-9078-b99a3f108bfa tempest-GroupsTest-1806779619 None] Group tempest-Group1-719804629: creating Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dc7d0-9ea5-46d7-aba0-16cb92d840f2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c948cc4b-db7c-4dbd-9078-b99a3f108bfa tempest-GroupsTest-1806779619 None] Group tempest-Group1-719804629: created successfully Aug 05 15:54:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c948cc4b-db7c-4dbd-9078-b99a3f108bfa tempest-GroupsTest-1806779619 None] Create group completed successfully. Aug 05 15:54:57 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f Aug 05 15:54:57 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:58 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f" returned: 0 in 0.604s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:58 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f Aug 05 15:54:58 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:58 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7007c9c9-1aac-445b-b104-1515eeaf557f" returned: 0 in 0.468s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-7007c9c9-1aac-445b-b104-1515eeaf557f" released by "delete_volume" :: held 1.174s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:58 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['84797dc3-a133-47c7-8d95-65a145cc3505'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:59 devstack cinder-volume[88715]: WARNING cinder.quota [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1505537351 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1505537351, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['36e2a7bc-37ad-4253-b08e-8b315fa344d4', '40a6a38a-d742-423c-ba9f-f3eb7401369c', '370e63de-a055-4591-8a7e-3c90c6f89622', '3d45886c-4b52-4c6c-b6d8-6ba7e49150d3'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b908b07f-002f-4bbd-a8a1-c96214d79b39 tempest-GroupsTest-1806779619 None] Group tempest-Group2-1832956155: creating Aug 05 15:54:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b908b07f-002f-4bbd-a8a1-c96214d79b39 tempest-GroupsTest-1806779619 None] Group tempest-Group2-1832956155: created successfully Aug 05 15:54:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b908b07f-002f-4bbd-a8a1-c96214d79b39 tempest-GroupsTest-1806779619 None] Create group completed successfully. Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['708446e0-9e3b-4daa-940f-ccbb8b2d296c', 'd92c77d3-2c45-41f6-a22a-ceeed25414d7', '5b833709-36eb-4739-ac7d-dd2541644b3a', '9ccef0e7-502d-4a3f-9bc8-d36fc9ce7098'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:59 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:54:59 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:59 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.312s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:59 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1e0681e2-26b1-403e-a021-1aba0cc63157 tempest-GroupSnapshotsTest-39649475 None] Delete group completed successfully. Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (d6ac6d50-1561-4354-91ec-26a7afe6ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d020774a-66db-4601-8cb8-b9f81ab916cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d020774a-66db-4601-8cb8-b9f81ab916cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630458347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83543850-d718-441e-bc5e-303546e4ac02,host='devstack@QuobyteHD#QuobyteHD',id=73acaaec-57c0-48f8-8703-4494bda90692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:01Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d479180c-bbe2-4d77-9b1a-bd6337527cc5),volume_type_id=d479180c-bbe2-4d77-9b1a-bd6337527cc5)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53923b44-f3e0-4146-8cdc-6816bc55e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53923b44-f3e0-4146-8cdc-6816bc55e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c9dbc-e691-4096-903f-7d887159af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c9dbc-e691-4096-903f-7d887159af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73acaaec-57c0-48f8-8703-4494bda90692', 'volume_name': 'volume-73acaaec-57c0-48f8-8703-4494bda90692', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade028c6-ea72-4a48-b50c-b3f158790d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade028c6-ea72-4a48-b50c-b3f158790d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c29f21-fbe5-4078-a3f1-a35e27a5e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Volume 73acaaec-57c0-48f8-8703-4494bda90692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73acaaec-57c0-48f8-8703-4494bda90692', 'volume_size': 1} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83543850-d718-441e-bc5e-303546e4ac02,created_at=2026-08-05T13:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630458347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83543850-d718-441e-bc5e-303546e4ac02,host='devstack@QuobyteHD#QuobyteHD',id=73acaaec-57c0-48f8-8703-4494bda90692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:01Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d479180c-bbe2-4d77-9b1a-bd6337527cc5),volume_type_id=d479180c-bbe2-4d77-9b1a-bd6337527cc5)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Creating volume 73acaaec-57c0-48f8-8703-4494bda90692 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:01 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b44bf417-0180-4053-bebd-3fb4870f147b tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-373216639: creating Aug 05 15:55:01 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 1073741824 Aug 05 15:55:01 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b44bf417-0180-4053-bebd-3fb4870f147b tempest-GroupSnapshotsTest-39649475 None] Group tempest-GroupSnapshotsTest-Group-373216639: created successfully Aug 05 15:55:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b44bf417-0180-4053-bebd-3fb4870f147b tempest-GroupSnapshotsTest-39649475 None] Create group completed successfully. Aug 05 15:55:02 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 1073741824" returned: 0 in 0.767s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:02 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 Aug 05 15:55:02 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:02 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692" returned: 0 in 0.410s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c29f21-fbe5-4078-a3f1-a35e27a5e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73acaaec-57c0-48f8-8703-4494bda90692', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfa44f7-cde5-4075-ab96-ac97ec6a0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Volume volume-73acaaec-57c0-48f8-8703-4494bda90692 (73acaaec-57c0-48f8-8703-4494bda90692): created successfully Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfa44f7-cde5-4075-ab96-ac97ec6a0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (d6ac6d50-1561-4354-91ec-26a7afe6ddde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b1fed6ed-ee0c-4a98-a8ef-2242993f5660 tempest-GroupsTest-1806779619 None] Created volume successfully. Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (ad985dce-29d2-4110-b7a1-a04094efaf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e527a5f-e800-4aec-8fa2-63047dfaad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e527a5f-e800-4aec-8fa2-63047dfaad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378242461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c52cd7a4-dbb6-4808-b56e-d5104c77f8b4,host='devstack@QuobyteHD#QuobyteHD',id=646c8a4c-dd3c-4229-abb8-468506576915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:03Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f652b753-6023-4e44-957f-19f1e537ff6e),volume_type_id=f652b753-6023-4e44-957f-19f1e537ff6e)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d66ddc-cb95-4e42-972d-06d7b79fa7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d66ddc-cb95-4e42-972d-06d7b79fa7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd40cb50-f29f-4b9e-9454-a06c75796bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd40cb50-f29f-4b9e-9454-a06c75796bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646c8a4c-dd3c-4229-abb8-468506576915', 'volume_name': 'volume-646c8a4c-dd3c-4229-abb8-468506576915', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d0bce-c29a-435f-a1a3-8eafbd65dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d0bce-c29a-435f-a1a3-8eafbd65dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563922f0-1e14-4910-8075-c40934646186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:03 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Volume 646c8a4c-dd3c-4229-abb8-468506576915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646c8a4c-dd3c-4229-abb8-468506576915', 'volume_size': 1} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c52cd7a4-dbb6-4808-b56e-d5104c77f8b4,created_at=2026-08-05T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1378242461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c52cd7a4-dbb6-4808-b56e-d5104c77f8b4,host='devstack@QuobyteHD#QuobyteHD',id=646c8a4c-dd3c-4229-abb8-468506576915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66d383d1f260471e9436c4b279c6e9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:03Z,use_quota=True,user_id='2ace87704d7a4bf8b050180943eea4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f652b753-6023-4e44-957f-19f1e537ff6e),volume_type_id=f652b753-6023-4e44-957f-19f1e537ff6e)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Creating volume 646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:03 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 1073741824 Aug 05 15:55:03 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:03 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:04 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:55:04 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 1073741824" returned: 0 in 0.754s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:04 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 Aug 05 15:55:04 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:04 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915" returned: 0 in 0.520s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563922f0-1e14-4910-8075-c40934646186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646c8a4c-dd3c-4229-abb8-468506576915', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349a608-51d8-4295-a5a6-369a52314f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Volume volume-646c8a4c-dd3c-4229-abb8-468506576915 (646c8a4c-dd3c-4229-abb8-468506576915): created successfully Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349a608-51d8-4295-a5a6-369a52314f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Flow 'volume_create_manager' (ad985dce-29d2-4110-b7a1-a04094efaf75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0867cb8c-b1dc-4fe9-a1c9-0bd430dbdbd6 tempest-GroupSnapshotsTest-39649475 None] Created volume successfully. Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Acquiring lock "cinder-quobyte-73acaaec-57c0-48f8-8703-4494bda90692" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-73acaaec-57c0-48f8-8703-4494bda90692" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c95436-f73c-49c4-a2f0-b15b85d1cdde]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 Aug 05 15:55:05 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692 Aug 05 15:55:05 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-73acaaec-57c0-48f8-8703-4494bda90692" returned: 0 in 0.289s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-73acaaec-57c0-48f8-8703-4494bda90692" released by "delete_volume" :: held 0.777s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Created reservations ['b28678c2-389f-4102-80a6-bdab36f120b6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Flow 'volume_create_manager' (43f459d3-5ec5-4390-b9ef-fd18c8123517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc12ed4-1e06-49ff-9722-e424ae73fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88715]: WARNING cinder.quota [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1754425882 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1754425882, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:06 devstack cinder-volume[88715]: WARNING cinder.quota [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1754425882 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1754425882, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc12ed4-1e06-49ff-9722-e424ae73fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-358969200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162e0157-db52-4b9e-b7fd-291f93feb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58c8bfd83ba4bb79b7bbec13d954143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:06Z,use_quota=True,user_id='41b06d8355c44f14be6c47bb0c3471ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c8abd92-b4cd-4b34-862f-c99332681d6f),volume_type_id=9c8abd92-b4cd-4b34-862f-c99332681d6f)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09ea733-9ff9-4a42-9807-a0cc9b2c7203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09ea733-9ff9-4a42-9807-a0cc9b2c7203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36dacf0-9f0d-4633-bea9-743f2bfc1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36dacf0-9f0d-4633-bea9-743f2bfc1972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162e0157-db52-4b9e-b7fd-291f93feb412', 'volume_name': 'volume-162e0157-db52-4b9e-b7fd-291f93feb412', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62625d31-1d41-413d-a5bc-03962d442c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62625d31-1d41-413d-a5bc-03962d442c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15adeb9f-1145-4bbf-9d78-4d31e80cbebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Volume 162e0157-db52-4b9e-b7fd-291f93feb412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162e0157-db52-4b9e-b7fd-291f93feb412', 'volume_size': 1} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-358969200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162e0157-db52-4b9e-b7fd-291f93feb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58c8bfd83ba4bb79b7bbec13d954143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:06Z,use_quota=True,user_id='41b06d8355c44f14be6c47bb0c3471ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c8abd92-b4cd-4b34-862f-c99332681d6f),volume_type_id=9c8abd92-b4cd-4b34-862f-c99332681d6f)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Creating volume 162e0157-db52-4b9e-b7fd-291f93feb412 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:06 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:06 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 1073741824 Aug 05 15:55:06 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Created reservations ['6155ef62-8c63-41f2-bd81-5e85fb363da0', '965d7cf3-bd18-4887-a89b-9d1368ea0083', 'ff4b89b1-e194-4d97-83d3-2d8463a2f54e', '923d52bb-61c7-4e86-a293-e326221745a6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] GroupSnapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: creating. Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Group snapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: creating. {{(pid=88715) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:06 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:06 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:06 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 1073741824" returned: 0 in 0.586s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:06 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:06 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9b102b35-94ae-4c1b-a647-777b6af1b730 tempest-GroupsTest-1806779619 None] Delete group completed successfully. Aug 05 15:55:06 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 Aug 05 15:55:06 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.796s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15adeb9f-1145-4bbf-9d78-4d31e80cbebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162e0157-db52-4b9e-b7fd-291f93feb412', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9e0739-2b92-45fe-84ad-462510827bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Creating offline snapshot b683cce4-987d-4ac7-a2a7-ca68d4311cd6 of volume 646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:07 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Volume volume-162e0157-db52-4b9e-b7fd-291f93feb412 (162e0157-db52-4b9e-b7fd-291f93feb412): created successfully Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9e0739-2b92-45fe-84ad-462510827bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Flow 'volume_create_manager' (43f459d3-5ec5-4390-b9ef-fd18c8123517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc957d02-68e6-4601-8c50-5a201dd49da3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-beac218b-cabd-4922-af82-3cc9337a3e10 tempest-VolumeTypesAccessTest-1524883536 None] Created volume successfully. Aug 05 15:55:07 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 Aug 05 15:55:07 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915" returned: 0 in 0.437s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 1G Aug 05 15:55:07 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Created reservations ['ba80e99c-6b95-4d87-ac56-326edac69e1e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:07 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 1G" returned: 0 in 0.460s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646c8a4c-dd3c-4229-abb8-468506576915 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646c8a4c-dd3c-4229-abb8-468506576915 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 Aug 05 15:55:08 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.330s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-231bb848-ad06-4c7e-aba5-423dd5452ef7 tempest-GroupsTest-1806779619 None] Delete group completed successfully. Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Acquiring lock "cinder-162e0157-db52-4b9e-b7fd-291f93feb412-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "cinder-162e0157-db52-4b9e-b7fd-291f93feb412-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Acquiring lock "cinder-quobyte-162e0157-db52-4b9e-b7fd-291f93feb412" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "cinder-quobyte-162e0157-db52-4b9e-b7fd-291f93feb412" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d502d-eed2-4943-9af4-6aef406ff8b5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 Aug 05 15:55:08 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646c8a4c-dd3c-4229-abb8-468506576915 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6" returned: 0 in 0.416s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 Aug 05 15:55:08 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412" returned: 0 in 0.392s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412 Aug 05 15:55:08 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info Aug 05 15:55:08 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-162e0157-db52-4b9e-b7fd-291f93feb412" returned: 0 in 0.335s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "cinder-quobyte-162e0157-db52-4b9e-b7fd-291f93feb412" released by "delete_volume" :: held 0.778s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:09 devstack cinder-volume[88715]: WARNING cinder.quota [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-512644462 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-512644462, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:09 devstack cinder-volume[88715]: WARNING cinder.quota [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-512644462 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-512644462, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:09 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Created reservations ['90f1597f-3712-443e-90a8-45423b0f44b5', 'e4dfaf5e-2bef-4986-b9ad-6117d1d726d5', '8db5ee08-23b7-4433-97d4-7adaadc7453e', '68484c19-f53d-4345-ad96-9256f19f3eaf'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:09 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info Aug 05 15:55:09 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:09 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.info" returned: 0 in 0.497s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7da0e1c0-656a-4d32-8a1f-d8075d9475db tempest-GroupsTest-1806779619 None] Group tempest-GroupsTest-Group-1607975303: creating Aug 05 15:55:09 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.472s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7da0e1c0-656a-4d32-8a1f-d8075d9475db tempest-GroupsTest-1806779619 None] Group tempest-GroupsTest-Group-1607975303: created successfully Aug 05 15:55:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Deleted volume successfully. Aug 05 15:55:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7da0e1c0-656a-4d32-8a1f-d8075d9475db tempest-GroupsTest-1806779619 None] Create group completed successfully. Aug 05 15:55:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1ea19ada-a6d2-43e4-a1f1-5aed4724b086 tempest-VolumeTypesAccessTest-1524883536 None] Lock "cinder-162e0157-db52-4b9e-b7fd-291f93feb412-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-67b2177e-11ee-4a58-9b4f-7aa12a4ab096 tempest-GroupSnapshotsTest-39649475 None] group_snapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: created successfully Aug 05 15:55:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] group_snapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: deleting Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] group_snapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: deleting {{(pid=88715) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-b683cce4-987d-4ac7-a2a7-ca68d4311cd6" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-b683cce4-987d-4ac7-a2a7-ca68d4311cd6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Deleting offline snapshot b683cce4-987d-4ac7-a2a7-ca68d4311cd6 of volume 646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] snapshot_file for this snap is: volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c26078-6cc8-4778-8db9-0d0a74127d2a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:11 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 Aug 05 15:55:11 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (8a6e5068-1215-4874-bf00-3aa07e8d7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edfa930-e327-42f1-ada4-af1b6d2fe94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edfa930-e327-42f1-ada4-af1b6d2fe94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079058711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e73994e2-143e-4400-9ccb-9dd4a5257750,host='devstack@QuobyteHD#QuobyteHD',id=90cabf18-a177-4945-b87d-6e76de255bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:12Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8cd978-a824-4377-9b3c-17249f86e45d),volume_type_id=1d8cd978-a824-4377-9b3c-17249f86e45d)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e045d985-944d-40b7-b1d2-37e3ae93f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e045d985-944d-40b7-b1d2-37e3ae93f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca32f166-7328-44bb-9303-c1ead4bf0663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca32f166-7328-44bb-9303-c1ead4bf0663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cabf18-a177-4945-b87d-6e76de255bf1', 'volume_name': 'volume-90cabf18-a177-4945-b87d-6e76de255bf1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dff8aa-d1d2-4e39-9c8f-a046fb65e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dff8aa-d1d2-4e39-9c8f-a046fb65e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcc82f4-2425-40a0-bee8-e9ecc88e9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:11 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Volume 90cabf18-a177-4945-b87d-6e76de255bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cabf18-a177-4945-b87d-6e76de255bf1', 'volume_size': 1} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e73994e2-143e-4400-9ccb-9dd4a5257750,created_at=2026-08-05T13:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079058711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e73994e2-143e-4400-9ccb-9dd4a5257750,host='devstack@QuobyteHD#QuobyteHD',id=90cabf18-a177-4945-b87d-6e76de255bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:12Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8cd978-a824-4377-9b3c-17249f86e45d),volume_type_id=1d8cd978-a824-4377-9b3c-17249f86e45d)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Creating volume 90cabf18-a177-4945-b87d-6e76de255bf1 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:11 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:11 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 1073741824 Aug 05 15:55:11 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6" returned: 0 in 0.913s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646c8a4c-dd3c-4229-abb8-468506576915(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f66e8-6302-4725-a8ea-cf6b31f20679]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 Aug 05 15:55:12 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 1073741824" returned: 0 in 0.644s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 Aug 05 15:55:12 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915" returned: 0 in 0.586s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 Aug 05 15:55:12 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcc82f4-2425-40a0-bee8-e9ecc88e9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cabf18-a177-4945-b87d-6e76de255bf1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86176538-89cb-4179-a007-33a7bd736c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Volume volume-90cabf18-a177-4945-b87d-6e76de255bf1 (90cabf18-a177-4945-b87d-6e76de255bf1): created successfully Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86176538-89cb-4179-a007-33a7bd736c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (8a6e5068-1215-4874-bf00-3aa07e8d7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2bfd9d14-a06c-46b1-a8be-38876663bbec tempest-GroupsTest-1806779619 None] Created volume successfully. Aug 05 15:55:13 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6" returned: 0 in 0.580s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:13 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6 Aug 05 15:55:13 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:13 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915.b683cce4-987d-4ac7-a2a7-ca68d4311cd6" returned: 0 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-b683cce4-987d-4ac7-a2a7-ca68d4311cd6" released by "_delete_snapshot" :: held 2.580s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" released by "delete_snapshot" :: held 2.626s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:13 devstack cinder-volume[88715]: WARNING cinder.quota [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-194064865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-194064865, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:13 devstack cinder-volume[88715]: WARNING cinder.quota [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-194064865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-194064865, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['162b7429-8cca-4ff0-8fd4-3662b64fce70', '3ce1708c-ce8f-4b7c-91c0-26631b9569ae', '757a3964-a27c-49ad-ab22-ba87fcb85a74', '4847371a-0376-4b4a-9329-31681d464eb1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6ff0a4fc-7a0c-43e1-9c9f-cae63e145bc6 tempest-GroupSnapshotsTest-39649475 None] group_snapshot 0998ebf1-04ac-479a-b4a7-2596e1f6cc68: deleted successfully Aug 05 15:55:13 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (53676b3f-0a9a-4689-8f84-671c933fd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d78a9e5-a6a4-43d3-9800-7f18ca9f4fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d78a9e5-a6a4-43d3-9800-7f18ca9f4fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90863906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e73994e2-143e-4400-9ccb-9dd4a5257750,host='devstack@QuobyteHD#QuobyteHD',id=477177e6-f84a-4ee0-8146-a0d56c3e2e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:14Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8cd978-a824-4377-9b3c-17249f86e45d),volume_type_id=1d8cd978-a824-4377-9b3c-17249f86e45d)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96322ce6-f097-450e-a40f-359ddcb8d7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96322ce6-f097-450e-a40f-359ddcb8d7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fc1f62-23fa-490e-8ef7-87c4a0e59899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fc1f62-23fa-490e-8ef7-87c4a0e59899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477177e6-f84a-4ee0-8146-a0d56c3e2e4e', 'volume_name': 'volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df85b05-fe47-4af3-98d3-c70c488a6886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df85b05-fe47-4af3-98d3-c70c488a6886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b710fe90-e200-4416-8be7-576abd5d72a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Volume 477177e6-f84a-4ee0-8146-a0d56c3e2e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e', 'volume_size': 1} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e73994e2-143e-4400-9ccb-9dd4a5257750,created_at=2026-08-05T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90863906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e73994e2-143e-4400-9ccb-9dd4a5257750,host='devstack@QuobyteHD#QuobyteHD',id=477177e6-f84a-4ee0-8146-a0d56c3e2e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133be49a0ded433a84b730d82b68a2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:14Z,use_quota=True,user_id='9c77d11f40ed4b4c9c23d31770b3710b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8cd978-a824-4377-9b3c-17249f86e45d),volume_type_id=1d8cd978-a824-4377-9b3c-17249f86e45d)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Creating volume 477177e6-f84a-4ee0-8146-a0d56c3e2e4e {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:14 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e 1073741824 Aug 05 15:55:14 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:14 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e 1073741824" returned: 0 in 0.517s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e Aug 05 15:55:14 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc99f0-fe8f-4215-8750-17b92143d807]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" returned: 0 in 0.307s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b710fe90-e200-4416-8be7-576abd5d72a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aead9294-d66a-469d-8f4c-8aad5a090e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Volume volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e (477177e6-f84a-4ee0-8146-a0d56c3e2e4e): created successfully Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aead9294-d66a-469d-8f4c-8aad5a090e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Flow 'volume_create_manager' (53676b3f-0a9a-4689-8f84-671c933fd90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-10d3f29a-03f9-41df-b040-134af6a66b69 tempest-GroupsTest-1806779619 None] Created volume successfully. Aug 05 15:55:15 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 Aug 05 15:55:15 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-56103d98-191c-4891-99e7-cd4be97867c1 tempest-GroupsTest-1806779619 None] Update group completed successfully. Aug 05 15:55:15 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915" returned: 0 in 0.477s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:15 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915 Aug 05 15:55:15 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:15 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-646c8a4c-dd3c-4229-abb8-468506576915" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Lock "cinder-quobyte-646c8a4c-dd3c-4229-abb8-468506576915" released by "delete_volume" :: held 0.845s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['845e0cd9-7967-454d-81ea-7366ead27f29'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:15 devstack cinder-volume[88715]: WARNING cinder.quota [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-194064865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-194064865, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Created reservations ['9bfea4ad-ff4c-4b06-bacd-a292a60df3ee', 'f158de13-96f5-4009-99d6-40c5c1102533', 'b6fed6de-bd12-438d-a0ce-0e7679d479d5', 'a2e72d11-6462-457b-86c0-4702f0d1ae42'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:16 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-dbc9a3a0-57e9-4570-8577-133991d9ae74 tempest-GroupSnapshotsTest-39649475 None] Delete group completed successfully. Aug 05 15:55:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2b214e19-37fa-493a-95d1-c8cedaee8df0 tempest-GroupsTest-1806779619 None] Update group completed successfully. Aug 05 15:55:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Acquiring lock "cinder-quobyte-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e1ca3-fb9f-4c5f-b24a-62beaad69e75]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:18 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e Aug 05 15:55:18 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" returned: 0 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e Aug 05 15:55:19 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-477177e6-f84a-4ee0-8146-a0d56c3e2e4e" released by "delete_volume" :: held 0.794s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Acquiring lock "cinder-quobyte-90cabf18-a177-4945-b87d-6e76de255bf1" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-90cabf18-a177-4945-b87d-6e76de255bf1" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d3346-2b24-4596-ab5c-39f0a99e5539]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 Aug 05 15:55:19 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1" returned: 0 in 0.498s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1 Aug 05 15:55:20 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-90cabf18-a177-4945-b87d-6e76de255bf1" returned: 0 in 0.312s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "cinder-quobyte-90cabf18-a177-4945-b87d-6e76de255bf1" released by "delete_volume" :: held 0.866s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Created reservations ['d4762854-0c87-4654-badb-eb9816681942'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:20 devstack cinder-volume[88715]: WARNING cinder.quota [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1854045416 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1854045416, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:20 devstack cinder-volume[88715]: WARNING cinder.quota [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1854045416 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1854045416, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Created reservations ['7f647001-219b-4144-8175-86613a371b45', '7b197950-f382-45e3-9e1b-d0ea4f68f77f', 'b0ee5784-18a1-4510-aec2-c8214ed122f6', '1039d35a-1975-439c-9a66-b0cdaafae8c2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Created reservations ['58dc9dd4-e389-4130-aa0a-3c99468ec048', 'c9653574-0f37-4777-ba24-66dae1d8d2fe', 'dc19ff8c-2ec2-47ae-a130-f946a31fb8e2', '8d2b57f8-422e-4569-9d10-f2f053325f98'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:20 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:21 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.401s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c6a9d03e-7ea0-4ed8-8989-983425ec3b90 tempest-GroupsTest-1806779619 None] Delete group completed successfully. Aug 05 15:55:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5fb467d-089f-45a7-8b84-5760f33e1c77 tempest-GroupsV314Test-469661695 None] Group tempest-GroupsV314Test-Group-475083849: creating Aug 05 15:55:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5fb467d-089f-45a7-8b84-5760f33e1c77 tempest-GroupsV314Test-469661695 None] Group tempest-GroupsV314Test-Group-475083849: created successfully Aug 05 15:55:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5fb467d-089f-45a7-8b84-5760f33e1c77 tempest-GroupsV314Test-469661695 None] Create group completed successfully. Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=190,cinder:UPDATE=204,cinder:DELETE=9,cinder:INSERT=52 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=182,cinder:UPDATE=216,cinder:INSERT=42,cinder:DELETE=11 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Flow 'volume_create_manager' (7ae6e043-06ed-4ddb-96f5-8edf950d1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f684af-3155-40f6-b291-4981f13c6b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f684af-3155-40f6-b291-4981f13c6b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1513604633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f681224-2009-47aa-b368-78c46c1a82e0,host='devstack@QuobyteHD#QuobyteHD',id=7176b69c-5956-453d-88a8-7a5e2a64440c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551a2e43ade049ee92310ab5ef9063ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:25Z,use_quota=True,user_id='8ab352ae076a4696b82de33a730198d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b30bd11-5bca-4d77-ace2-e406a411504b),volume_type_id=8b30bd11-5bca-4d77-ace2-e406a411504b)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a243de9-856e-47e6-a2b4-837c3ef74080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a243de9-856e-47e6-a2b4-837c3ef74080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bb0421-704d-4ea9-80fd-cfba8ad529af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bb0421-704d-4ea9-80fd-cfba8ad529af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7176b69c-5956-453d-88a8-7a5e2a64440c', 'volume_name': 'volume-7176b69c-5956-453d-88a8-7a5e2a64440c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99854d37-279c-4ab5-a918-d22da1b27b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99854d37-279c-4ab5-a918-d22da1b27b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e353d6-f411-4cf9-b39d-447eed7c51c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Volume 7176b69c-5956-453d-88a8-7a5e2a64440c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7176b69c-5956-453d-88a8-7a5e2a64440c', 'volume_size': 1} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f681224-2009-47aa-b368-78c46c1a82e0,created_at=2026-08-05T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1513604633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f681224-2009-47aa-b368-78c46c1a82e0,host='devstack@QuobyteHD#QuobyteHD',id=7176b69c-5956-453d-88a8-7a5e2a64440c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551a2e43ade049ee92310ab5ef9063ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:25Z,use_quota=True,user_id='8ab352ae076a4696b82de33a730198d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b30bd11-5bca-4d77-ace2-e406a411504b),volume_type_id=8b30bd11-5bca-4d77-ace2-e406a411504b)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Creating volume 7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:25 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:25 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c 1073741824 Aug 05 15:55:25 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:26 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c 1073741824" returned: 0 in 0.664s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:26 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:26 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:26 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.423s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e353d6-f411-4cf9-b39d-447eed7c51c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7176b69c-5956-453d-88a8-7a5e2a64440c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485b29b0-7f6f-47a2-8012-827318fb32de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d0641f-28a1-431a-a869-43728332152b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Volume volume-7176b69c-5956-453d-88a8-7a5e2a64440c (7176b69c-5956-453d-88a8-7a5e2a64440c): created successfully Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485b29b0-7f6f-47a2-8012-827318fb32de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Flow 'volume_create_manager' (7ae6e043-06ed-4ddb-96f5-8edf950d1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-64f72886-e07d-4e3e-857c-6b467593bf5b tempest-GroupsV314Test-469661695 None] Created volume successfully. Aug 05 15:55:26 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f Aug 05 15:55:26 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:26 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.523s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-0dd1a539-c13d-4207-b871-8b5159e6948f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5f71c1b-bd7d-45fc-a59f-6c96408d3aa6', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:55:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-24c35391-f001-4808-b945-c1c4749c3075 req-2a4779a2-4f6b-4750-8afd-b90b17ade290 tempest-TestServerVolumeAttachmentScenario-2030713809 None] attachment_update completed successfully. Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:28 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Cloning volume 7176b69c-5956-453d-88a8-7a5e2a64440c to volume acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Creating offline snapshot da8f0346-6386-46c4-aaf6-a051f33ae3e4 of volume 7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c72a17b-4acd-4e67-b9f3-8da906e3363c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:28 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:28 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:28 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.491s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:28 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 1G Aug 05 15:55:28 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 1G" returned: 0 in 0.576s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7176b69c-5956-453d-88a8-7a5e2a64440c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7176b69c-5956-453d-88a8-7a5e2a64440c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:29 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7176b69c-5956-453d-88a8-7a5e2a64440c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.435s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:55:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:29 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:30 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.384s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Flow 'volume_create_manager' (b8c793b4-6115-44ef-abc0-f803c4194837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3067f2-a7f9-42fd-805e-b29ae6689b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3067f2-a7f9-42fd-805e-b29ae6689b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749430516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09094847-05c6-4ce7-8503-d5b3a31833b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59d1ea6b3c9430aac0d8d079b81fa8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:30Z,use_quota=True,user_id='03a5d8a453cc40ba99ed571a85efba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa28ee14-5979-4459-9313-30370c5c59b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa28ee14-5979-4459-9313-30370c5c59b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa14b9d-4bc5-402e-9088-861ef60f5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa14b9d-4bc5-402e-9088-861ef60f5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09094847-05c6-4ce7-8503-d5b3a31833b7', 'volume_name': 'volume-09094847-05c6-4ce7-8503-d5b3a31833b7', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43899b2e-c489-4096-aabf-81379889e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43899b2e-c489-4096-aabf-81379889e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655c3e28-8c25-4cad-9e74-b97f650f8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Volume 09094847-05c6-4ce7-8503-d5b3a31833b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09094847-05c6-4ce7-8503-d5b3a31833b7', 'volume_size': 1} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:30 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info Aug 05 15:55:30 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:30 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info" returned: 0 in 0.304s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:30 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:55:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:30 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info Aug 05 15:55:30 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:31 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.info" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Acquiring lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] snapshot: da8f0346-6386-46c4-aaf6-a051f33ae3e4, volume: acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[22acf0e3-f9d6-43b2-89ab-063e5f58d378]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:31 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:31 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:31 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.394s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176b69c-5956-453d-88a8-7a5e2a64440c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[20315f5f-ebbb-4cfa-83e3-dd9dc1fd11bc]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:31 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:31 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:32 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.438s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:32 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:55:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:32 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff Aug 05 15:55:32 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:37 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" returned: 0 in 5.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20481c-31cd-4818-918e-4285b03ab833]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:37 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:37 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.592s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:55:38 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Converted 1024.00 MB image at 186.88 MB/s Aug 05 15:55:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:38 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff Aug 05 15:55:38 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" released by "_copy_volume_from_snapshot" :: held 7.306s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Acquiring lock "cinder-quobyte-da8f0346-6386-46c4-aaf6-a051f33ae3e4" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-da8f0346-6386-46c4-aaf6-a051f33ae3e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Deleting offline snapshot da8f0346-6386-46c4-aaf6-a051f33ae3e4 of volume 7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] snapshot_file for this snap is: volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf34c6-9685-4506-b801-fd7f1cc77814]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:38 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:38 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.428s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176b69c-5956-453d-88a8-7a5e2a64440c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe885779-9d67-42a2-bb13-8bef1b978081]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:39 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:39 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:39 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:39 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:39 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:39 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:39 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4 Aug 05 15:55:39 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:40 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c.da8f0346-6386-46c4-aaf6-a051f33ae3e4" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-da8f0346-6386-46c4-aaf6-a051f33ae3e4" released by "_delete_snapshot" :: held 1.586s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.737s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.636s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749430516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09094847-05c6-4ce7-8503-d5b3a31833b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59d1ea6b3c9430aac0d8d079b81fa8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:30Z,use_quota=True,user_id='03a5d8a453cc40ba99ed571a85efba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Creating volume 09094847-05c6-4ce7-8503-d5b3a31833b7 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:40 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:40 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 1073741824 Aug 05 15:55:40 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e84400b8-3e7e-4e7c-9342-60ea9da0439c tempest-GroupsV314Test-469661695 None] Create group from source-group-8f681224-2009-47aa-b368-78c46c1a82e0 completed successfully. Aug 05 15:55:40 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 1073741824" returned: 0 in 0.494s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:40 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 Aug 05 15:55:40 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:40 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.725s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655c3e28-8c25-4cad-9e74-b97f650f8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09094847-05c6-4ce7-8503-d5b3a31833b7', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f3d09c-55ec-494a-86c2-79ff429eca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b6c6c-5391-4af4-86ee-3db8a23afb1e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:40 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Volume volume-09094847-05c6-4ce7-8503-d5b3a31833b7 (09094847-05c6-4ce7-8503-d5b3a31833b7): created successfully Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f3d09c-55ec-494a-86c2-79ff429eca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Flow 'volume_create_manager' (b8c793b4-6115-44ef-abc0-f803c4194837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f91d150c-ee41-47b8-b871-ab3e689dbea2 tempest-VolumesTransfersTest-1228346672 None] Created volume successfully. Aug 05 15:55:41 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae Aug 05 15:55:41 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:41 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" returned: 0 in 0.372s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.396s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '646d32ed-84c1-4ff4-b43e-255b1ab6c096', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:55:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-a382a50b-3054-40fc-aa61-afc27fcad852 req-1dc43464-5368-4685-95c3-95a70908b1d5 tempest-TestServerVolumeAttachmentScenario-2030713809 None] attachment_update completed successfully. Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Acquiring lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[300329f9-954b-453a-91ab-7c74ca48e0c6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:42 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8a8f4d41-ad4d-4207-b195-acbf1f8694b5 tempest-VolumesTransfersTest-1364914238 None] Transfer volume completed successfully. Aug 05 15:55:42 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff Aug 05 15:55:42 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:42 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" returned: 0 in 0.641s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:43 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff Aug 05 15:55:43 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:43 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" returned: 0 in 0.363s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-acff1d4d-6a75-4c8b-b31c-dc7f6bebc8ff" released by "delete_volume" :: held 1.066s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Created reservations ['771c5a1e-f36e-4113-aaf3-a116ab6cc3f0'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:43 devstack cinder-volume[88715]: WARNING cinder.quota [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-68306836 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-68306836, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:43 devstack cinder-volume[88715]: WARNING cinder.quota [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-68306836 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-68306836, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Created reservations ['b47435d0-dbef-41b7-8955-18e9878a5b17', 'f83d07e4-c696-4c88-8bf1-bb5b09f8e5d0', 'dbb156ad-081d-44e4-9edf-58d09d44ab7f', '88700589-3f88-4ee3-899e-50091ab1d8a9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "cinder-09094847-05c6-4ce7-8503-d5b3a31833b7-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:43 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:43 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-09094847-05c6-4ce7-8503-d5b3a31833b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "cinder-quobyte-09094847-05c6-4ce7-8503-d5b3a31833b7" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-quobyte-09094847-05c6-4ce7-8503-d5b3a31833b7" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062d3f2-77d1-42c6-b696-03dd502dca8a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.321s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a5da8680-e0f7-463d-a80b-4778c1aa6a38 tempest-GroupsV314Test-469661695 None] Delete group completed successfully. Aug 05 15:55:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-e0cdd0e6-ee22-4a92-888c-d88134683d7c req-f28fac62-01ba-404b-9e7e-39ce468225da tempest-TestServerVolumeAttachmentScenario-2030713809 None] Terminate volume connection completed successfully. Aug 05 15:55:44 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 Aug 05 15:55:44 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-e0cdd0e6-ee22-4a92-888c-d88134683d7c req-f28fac62-01ba-404b-9e7e-39ce468225da tempest-TestServerVolumeAttachmentScenario-2030713809 None] Deleting attachment 646d32ed-84c1-4ff4-b43e-255b1ab6c096. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Acquiring lock "cinder-quobyte-7176b69c-5956-453d-88a8-7a5e2a64440c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-7176b69c-5956-453d-88a8-7a5e2a64440c" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c03242-a2c8-4869-994d-3e1537e53c69]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:44 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:44 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7" returned: 0 in 0.527s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7 Aug 05 15:55:44 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:44 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.461s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c Aug 05 15:55:44 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:44 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-09094847-05c6-4ce7-8503-d5b3a31833b7" returned: 0 in 0.325s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-quobyte-09094847-05c6-4ce7-8503-d5b3a31833b7" released by "delete_volume" :: held 0.917s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Created reservations ['264bf5b1-bb32-4998-a467-f856f4148476', '7b916cc3-8566-4bf0-ba59-2d626e249ef7', '416d128d-5888-41c9-933a-ae5315c45e2b', '58b9ef2f-8f96-4b8e-9fcf-ab79f05ad887'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:44 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:45 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7176b69c-5956-453d-88a8-7a5e2a64440c" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Lock "cinder-quobyte-7176b69c-5956-453d-88a8-7a5e2a64440c" released by "delete_volume" :: held 0.954s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Created reservations ['4c1e5344-1f9d-46cc-bde7-951680093112'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:45 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.330s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Deleted volume successfully. Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0132485e-9301-45ad-bb04-5d4e99d8c5e3 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-09094847-05c6-4ce7-8503-d5b3a31833b7-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Created reservations ['6373e248-3c55-4d60-87be-d2112d8a3264', '17557364-69a7-48f2-a7a3-3cbff9c62277', '5cbd8f27-b151-4f20-b554-789822b09875', 'df748c01-5133-459d-9435-37a9473f2baf'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:45 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:45 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-3c3b73c7-1783-4947-85ce-ca30f572c97f req-08f99ef4-d0e3-4a66-9800-4dda4f5e0338 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Terminate volume connection completed successfully. Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-3c3b73c7-1783-4947-85ce-ca30f572c97f req-08f99ef4-d0e3-4a66-9800-4dda4f5e0338 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Deleting attachment c5f71c1b-bd7d-45fc-a59f-6c96408d3aa6. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:55:45 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.434s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:45 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cc5814be-897a-457e-8a3a-bd70463b3556 tempest-GroupsV314Test-469661695 None] Delete group completed successfully. Aug 05 15:55:46 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Flow 'volume_create_manager' (0dde6399-c9c9-4ef9-bc64-03a51c6aff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:46 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3ebe0-f009-402f-8754-8a23d9728488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3ebe0-f009-402f-8754-8a23d9728488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1010536263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62587c9-c9fe-43ac-994b-f7115c803539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59d1ea6b3c9430aac0d8d079b81fa8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:47Z,use_quota=True,user_id='03a5d8a453cc40ba99ed571a85efba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5c0e68-07b0-4166-839b-149b38c779a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5c0e68-07b0-4166-839b-149b38c779a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5e7382-dbc3-4d52-99ec-fbecbb7f6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5e7382-dbc3-4d52-99ec-fbecbb7f6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62587c9-c9fe-43ac-994b-f7115c803539', 'volume_name': 'volume-f62587c9-c9fe-43ac-994b-f7115c803539', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bdacf7-27a8-400a-bc36-fb1e1980eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bdacf7-27a8-400a-bc36-fb1e1980eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69cccb6-e556-45eb-a263-a78c36f306ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:47 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Volume f62587c9-c9fe-43ac-994b-f7115c803539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62587c9-c9fe-43ac-994b-f7115c803539', 'volume_size': 1} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1010536263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62587c9-c9fe-43ac-994b-f7115c803539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59d1ea6b3c9430aac0d8d079b81fa8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:47Z,use_quota=True,user_id='03a5d8a453cc40ba99ed571a85efba46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Creating volume f62587c9-c9fe-43ac-994b-f7115c803539 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:47 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:47 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 1073741824 Aug 05 15:55:47 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:47 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 1073741824" returned: 0 in 0.682s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:47 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 Aug 05 15:55:47 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:48 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539" returned: 0 in 0.475s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69cccb6-e556-45eb-a263-a78c36f306ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62587c9-c9fe-43ac-994b-f7115c803539', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b2edb-0b6f-4b43-b9a3-fe9f60d1a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Volume volume-f62587c9-c9fe-43ac-994b-f7115c803539 (f62587c9-c9fe-43ac-994b-f7115c803539): created successfully Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b2edb-0b6f-4b43-b9a3-fe9f60d1a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Flow 'volume_create_manager' (0dde6399-c9c9-4ef9-bc64-03a51c6aff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:48 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-620c8f75-0a7c-4c9f-9f3e-0006e3593ebd tempest-VolumesTransfersTest-1228346672 None] Created volume successfully. Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "cinder-f62587c9-c9fe-43ac-994b-f7115c803539-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-f62587c9-c9fe-43ac-994b-f7115c803539-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "cinder-quobyte-f62587c9-c9fe-43ac-994b-f7115c803539" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-quobyte-f62587c9-c9fe-43ac-994b-f7115c803539" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[341c960b-f838-4759-b4f1-509bcaec6e08]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:49 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 Aug 05 15:55:49 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539" returned: 0 in 0.489s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539 Aug 05 15:55:50 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f62587c9-c9fe-43ac-994b-f7115c803539" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-quobyte-f62587c9-c9fe-43ac-994b-f7115c803539" released by "delete_volume" :: held 0.853s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Created reservations ['4a58fc31-cb32-4633-b07b-7356fd8b3564', '9b83e254-d71b-40e2-a589-caeeb9fdd45f', '6816c417-4231-42d4-84e7-4917d6b3ee29', '3dd19e7d-cfd4-46e8-a2a6-d36188ce96f7'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:50 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Deleted volume successfully. Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7243c5c2-a3e0-4e0e-877e-86e978d1aa05 tempest-VolumesTransfersTest-1984123708 None] Lock "cinder-f62587c9-c9fe-43ac-994b-f7115c803539-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "cinder-8a3fc37b-914a-4169-95b3-d5c1412cb4ae-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-8a3fc37b-914a-4169-95b3-d5c1412cb4ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "cinder-quobyte-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-quobyte-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e345c-7a5c-4500-aa51-3444c64faef6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:51 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae Aug 05 15:55:51 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae Aug 05 15:55:52 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Flow 'volume_create_manager' (fd3fa622-e223-45a2-b4b7-54cce7e5494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bda8fa-fa15-4c0e-96c6-7ff974b2dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bda8fa-fa15-4c0e-96c6-7ff974b2dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1249243575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378b5119-6f49-4cc1-8156-863bac45f63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4292307185aa485faf25908ab5eac8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:52Z,use_quota=True,user_id='7a470f2ba3084ab3811bb73c5a5a5103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2891d16-de58-41be-80bf-d56922ce9814),volume_type_id=d2891d16-de58-41be-80bf-d56922ce9814)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b91e5-fed3-477e-ab8b-d6f7e1ab457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b91e5-fed3-477e-ab8b-d6f7e1ab457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c859eb-1a75-4b0f-bab1-0dcf37e3ada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c859eb-1a75-4b0f-bab1-0dcf37e3ada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378b5119-6f49-4cc1-8156-863bac45f63c', 'volume_name': 'volume-378b5119-6f49-4cc1-8156-863bac45f63c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3c64c2-e00d-437c-b3fd-342702dfdda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3c64c2-e00d-437c-b3fd-342702dfdda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fd6e80-f66a-4ec4-8a7a-f2baf91512c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Volume 378b5119-6f49-4cc1-8156-863bac45f63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378b5119-6f49-4cc1-8156-863bac45f63c', 'volume_size': 1} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1249243575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378b5119-6f49-4cc1-8156-863bac45f63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4292307185aa485faf25908ab5eac8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:52Z,use_quota=True,user_id='7a470f2ba3084ab3811bb73c5a5a5103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2891d16-de58-41be-80bf-d56922ce9814),volume_type_id=d2891d16-de58-41be-80bf-d56922ce9814)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Creating volume 378b5119-6f49-4cc1-8156-863bac45f63c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:55:52 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" returned: 0 in 0.331s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-quobyte-8a3fc37b-914a-4169-95b3-d5c1412cb4ae" released by "delete_volume" :: held 0.869s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:52 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c 1073741824 Aug 05 15:55:52 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Created reservations ['9abe5bca-86af-499b-a4ae-565abe37052f', '59804a77-2a47-42a0-8a5e-5a64131a8e09', 'd84a5c02-00ae-455b-b53d-0b7203252b06', 'adde7a78-e6ca-4212-8785-f211e690f2c8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "cinder-0dd1a539-c13d-4207-b871-8b5159e6948f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:52 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:52 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-0dd1a539-c13d-4207-b871-8b5159e6948f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "cinder-quobyte-0dd1a539-c13d-4207-b871-8b5159e6948f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-quobyte-0dd1a539-c13d-4207-b871-8b5159e6948f" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[60336935-0389-47ec-b918-d0197f742585]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f Aug 05 15:55:53 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.388s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Deleted volume successfully. Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ea78aef-d620-420b-b029-bac9e985cb17 tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-8a3fc37b-914a-4169-95b3-d5c1412cb4ae-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:53 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c 1073741824" returned: 0 in 0.848s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c Aug 05 15:55:53 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f" returned: 0 in 0.625s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f Aug 05 15:55:53 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fd6e80-f66a-4ec4-8a7a-f2baf91512c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378b5119-6f49-4cc1-8156-863bac45f63c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b70ab6-8a3f-410d-a0cc-906c28ec1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Volume volume-378b5119-6f49-4cc1-8156-863bac45f63c (378b5119-6f49-4cc1-8156-863bac45f63c): created successfully Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b70ab6-8a3f-410d-a0cc-906c28ec1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Flow 'volume_create_manager' (fd3fa622-e223-45a2-b4b7-54cce7e5494c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:53 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd1a539-c13d-4207-b871-8b5159e6948f" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-quobyte-0dd1a539-c13d-4207-b871-8b5159e6948f" released by "delete_volume" :: held 0.950s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-762e39c2-0ff4-41d5-9cdc-627ec656147c tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Created volume successfully. Aug 05 15:55:53 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Created reservations ['876b10fb-c596-46a1-9081-67febf8afa94', '92e8e49a-bb0a-47b8-8985-6503375ed04a', '6215036c-2ac2-4660-9106-8d8356d2f6f5', 'a43f7574-dcae-4d43-9f58-9e8936e1ae07'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:54 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:54 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:54 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.308s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Deleted volume successfully. Aug 05 15:55:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d5927097-6195-41e6-a7f3-53acb37fcb0f tempest-TestServerVolumeAttachmentScenario-2030713809 None] Lock "cinder-0dd1a539-c13d-4207-b871-8b5159e6948f-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:55 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:55 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:55 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.366s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:55 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b14b1e4c-edb9-418b-9aec-ad52ddcc31a6 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Retype volume completed successfully. Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "cinder-378b5119-6f49-4cc1-8156-863bac45f63c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "cinder-378b5119-6f49-4cc1-8156-863bac45f63c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "cinder-quobyte-378b5119-6f49-4cc1-8156-863bac45f63c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "cinder-quobyte-378b5119-6f49-4cc1-8156-863bac45f63c" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c6ba5-af3b-4097-9f74-cebc472127e7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:56 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c Aug 05 15:55:56 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:57 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c" returned: 0 in 0.471s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:57 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c Aug 05 15:55:57 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:57 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-378b5119-6f49-4cc1-8156-863bac45f63c" returned: 0 in 0.358s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "cinder-quobyte-378b5119-6f49-4cc1-8156-863bac45f63c" released by "delete_volume" :: held 0.905s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:57 devstack cinder-volume[88715]: WARNING cinder.quota [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:57 devstack cinder-volume[88715]: WARNING cinder.quota [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Created reservations ['6405519e-5e61-4901-b81e-cbb1d3ddaab3', '25a69739-7a7c-47b7-a8ab-9694cf61fa88', '56a93dd7-723d-4189-b952-5a65b4ba48ef', '490b1f76-9d9e-4a83-b7cb-4c8ad76bb03a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:57 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:55:57 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:58 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.361s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:58 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Deleted volume successfully. Aug 05 15:55:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f7e8311-4807-40c3-a66b-d488adde4f91 tempest-VolumeRetypeWithoutMigrationTest-433423512 None] Lock "cinder-378b5119-6f49-4cc1-8156-863bac45f63c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:56:03 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:04 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:56:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:56:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:56:07 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=75,cinder:UPDATE=82,cinder:DELETE=3,cinder:INSERT=19 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:56:08 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=79,cinder:UPDATE=87,cinder:INSERT=17,cinder:DELETE=6 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Flow 'volume_create_manager' (160524c8-bc37-4b77-8cbc-324cd91c341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5933f7a1-5f99-47b4-9cea-5f07659ec5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5933f7a1-5f99-47b4-9cea-5f07659ec5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145364072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa43a8-51dc-4a45-b13d-fb9f266c3d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810fed0047dc4fc2886dcb8f36d57fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:09Z,use_quota=True,user_id='0a007b9e53e2499e886658caf4bc6e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ee7c73-14f4-47af-aa5f-c68b3fdeb8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ee7c73-14f4-47af-aa5f-c68b3fdeb8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d48ee4-2524-458f-964a-5baf977d70fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d48ee4-2524-458f-964a-5baf977d70fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28aa43a8-51dc-4a45-b13d-fb9f266c3d94', 'volume_name': 'volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2508aa58-58b2-4eef-8856-910bd0f18317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2508aa58-58b2-4eef-8856-910bd0f18317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53652ef9-107f-4417-8eeb-d8cdb62c1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:09 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94', 'volume_size': 1} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145364072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa43a8-51dc-4a45-b13d-fb9f266c3d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810fed0047dc4fc2886dcb8f36d57fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:09Z,use_quota=True,user_id='0a007b9e53e2499e886658caf4bc6e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Creating volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:56:09 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:09 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 1073741824 Aug 05 15:56:09 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:09 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 1073741824" returned: 0 in 0.678s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:10 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:56:10 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:10 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53652ef9-107f-4417-8eeb-d8cdb62c1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d258bb03-9c90-48fe-8166-81235b95be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:10 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Volume volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 (28aa43a8-51dc-4a45-b13d-fb9f266c3d94): created successfully Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d258bb03-9c90-48fe-8166-81235b95be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Flow 'volume_create_manager' (160524c8-bc37-4b77-8cbc-324cd91c341c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-65de09dd-161b-4f99-8c55-cd4aac744883 tempest-VolumesActionsTest-1217163062 None] Created volume successfully. Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Flow 'volume_create_manager' (ef80b015-3f7a-4143-9a6d-17ae55b489db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc73e544-dae8-4703-b862-e9ef77d4c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc73e544-dae8-4703-b862-e9ef77d4c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1452124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151106a0-2317-4cea-bf55-d984af0e7eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4508b8f36704d518b7725fda48bd5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:18Z,use_quota=True,user_id='1612085f2af948febdfb6d01a3c16801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2076d6c9-d1e7-44a2-a3fc-f2d1f98d496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2076d6c9-d1e7-44a2-a3fc-f2d1f98d496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fe2389-2cd3-4cfa-85bc-83d269b69c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fe2389-2cd3-4cfa-85bc-83d269b69c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151106a0-2317-4cea-bf55-d984af0e7eb4', 'volume_name': 'volume-151106a0-2317-4cea-bf55-d984af0e7eb4', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f0fe69-8243-4557-b5dc-2c378b9bb82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f0fe69-8243-4557-b5dc-2c378b9bb82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28ecbbe-017f-4ee5-9b03-6756be274328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:18 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Volume 151106a0-2317-4cea-bf55-d984af0e7eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151106a0-2317-4cea-bf55-d984af0e7eb4', 'volume_size': 1} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1452124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151106a0-2317-4cea-bf55-d984af0e7eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4508b8f36704d518b7725fda48bd5bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:18Z,use_quota=True,user_id='1612085f2af948febdfb6d01a3c16801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Creating volume 151106a0-2317-4cea-bf55-d984af0e7eb4 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:56:18 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:18 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 1073741824 Aug 05 15:56:18 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:18 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 1073741824" returned: 0 in 0.846s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:19 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 Aug 05 15:56:19 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:19 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4" returned: 0 in 0.310s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28ecbbe-017f-4ee5-9b03-6756be274328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151106a0-2317-4cea-bf55-d984af0e7eb4', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13a5ce-d756-4d4c-bacc-3033a9576fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Volume volume-151106a0-2317-4cea-bf55-d984af0e7eb4 (151106a0-2317-4cea-bf55-d984af0e7eb4): created successfully Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d13a5ce-d756-4d4c-bacc-3033a9576fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Flow 'volume_create_manager' (ef80b015-3f7a-4143-9a6d-17ae55b489db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5dfc53be-81b4-46cc-ae7b-b66b52d0f864 tempest-VolumesServicesTestJSON-1804878030 None] Created volume successfully. Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Acquiring lock "cinder-151106a0-2317-4cea-bf55-d984af0e7eb4-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "cinder-151106a0-2317-4cea-bf55-d984af0e7eb4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Acquiring lock "cinder-quobyte-151106a0-2317-4cea-bf55-d984af0e7eb4" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "cinder-quobyte-151106a0-2317-4cea-bf55-d984af0e7eb4" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef68902-f23b-4621-b8ad-e5d284c21c90]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:20 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 Aug 05 15:56:20 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:20 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4" returned: 0 in 0.479s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:20 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4 Aug 05 15:56:20 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:21 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-151106a0-2317-4cea-bf55-d984af0e7eb4" returned: 0 in 0.518s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "cinder-quobyte-151106a0-2317-4cea-bf55-d984af0e7eb4" released by "delete_volume" :: held 1.064s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Created reservations ['963aa910-74b9-48a8-a8d4-49d0dc7b98d2', 'b49e7d77-8f09-4bb5-aa03-8c67ad818601', '38161a26-9a6c-4b0d-8fa9-6ab00a5e9dcc', 'e6447100-f323-4447-b9d6-796512cbeff2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:21 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:56:21 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:21 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Deleted volume successfully. Aug 05 15:56:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ac838af9-ffa3-454e-99ef-1fddd2fe1c9d tempest-VolumesServicesTestJSON-1804878030 None] Lock "cinder-151106a0-2317-4cea-bf55-d984af0e7eb4-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b77565ba-dd8f-496b-8c66-2c4cfe668a23 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" by "attach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b77565ba-dd8f-496b-8c66-2c4cfe668a23 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" acquired by "attach_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b77565ba-dd8f-496b-8c66-2c4cfe668a23 tempest-VolumesActionsTest-1217163062 None] Attaching volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94 to instance f82050ac-fd08-450a-9ca0-96e6f7c1578e at mountpoint /dev/vdb on host None. Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b77565ba-dd8f-496b-8c66-2c4cfe668a23 tempest-VolumesActionsTest-1217163062 None] Attach volume completed successfully. Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b77565ba-dd8f-496b-8c66-2c4cfe668a23 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" released by "attach_volume" :: held 0.119s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Flow 'volume_create_manager' (6fce0559-c0e0-420b-a48c-6db08be949da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cc2889-8172-4e4d-9266-598bd6aaf414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-070a5ba8-ac69-4a54-951b-a777c83a649a tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" by "detach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5cc2889-8172-4e4d-9266-598bd6aaf414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98642fe1-bf36-459f-af22-4631c3122af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21104eabc4634943bd4a0eb1aa24cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:22Z,use_quota=True,user_id='cdc936089a16413c974e0d8a1af5bdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4627f7a-f5af-45eb-982f-ed4e6e568599),volume_type_id=f4627f7a-f5af-45eb-982f-ed4e6e568599)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdff7c42-3030-46e0-9290-909bb89c9056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdff7c42-3030-46e0-9290-909bb89c9056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfa1220-4212-444e-82c7-954e2ae71002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-070a5ba8-ac69-4a54-951b-a777c83a649a tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-070a5ba8-ac69-4a54-951b-a777c83a649a tempest-VolumesActionsTest-1217163062 None] Detaching volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94 from instance f82050ac-fd08-450a-9ca0-96e6f7c1578e. Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Flow 'volume_create_manager' (2fb73f8d-d7d7-40e0-9483-90488a46f201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d8786f-ed47-4c14-82f7-2d4d97cb5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d8786f-ed47-4c14-82f7-2d4d97cb5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-983718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd78f3f-c8a1-4133-bbc0-d4024e36ef28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69b82698fa941e585a0b7dab902d3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:22Z,use_quota=True,user_id='deec7f8190a84023bc250c1cfeb18e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059a0588-eea4-41fc-986c-0b823b5ebe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059a0588-eea4-41fc-986c-0b823b5ebe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c84e610-0a84-4a63-b3f4-1164041868ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c84e610-0a84-4a63-b3f4-1164041868ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd78f3f-c8a1-4133-bbc0-d4024e36ef28', 'volume_name': 'volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c439191-4f06-4486-afab-b8d6f958be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c439191-4f06-4486-afab-b8d6f958be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6331bd44-a6b6-4292-b917-62090f71de4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Volume 0dd78f3f-c8a1-4133-bbc0-d4024e36ef28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28', 'volume_size': 1} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-983718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd78f3f-c8a1-4133-bbc0-d4024e36ef28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69b82698fa941e585a0b7dab902d3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:22Z,use_quota=True,user_id='deec7f8190a84023bc250c1cfeb18e4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Creating volume 0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:22 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 1073741824 Aug 05 15:56:22 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-070a5ba8-ac69-4a54-951b-a777c83a649a tempest-VolumesActionsTest-1217163062 None] Detach volume completed successfully. Aug 05 15:56:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-070a5ba8-ac69-4a54-951b-a777c83a649a tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" released by "detach_volume" :: held 0.255s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:23 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfa1220-4212-444e-82c7-954e2ae71002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98642fe1-bf36-459f-af22-4631c3122af2', 'volume_name': 'volume-98642fe1-bf36-459f-af22-4631c3122af2', 'volume_size': 1, 'image_id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c8b3dfe572793ca19506a261f156078', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21104eabc4634943bd4a0eb1aa24cba1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab8a371f095f74c8516a3b54543886028d11bb49d31653dca0839c3f2bd17efdd350ba1601eca53741cc52cf2fc0beef8d2f5c870e3a6a614531be4b334952c0', 'id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'created_at': datetime.datetime(2026, 8, 5, 13, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77650f49-67e8-4b5a-9ed1-107de4ff9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77650f49-67e8-4b5a-9ed1-107de4ff9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc155cec-16ad-4efd-93a9-39a69d73ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:23 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Volume 98642fe1-bf36-459f-af22-4631c3122af2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98642fe1-bf36-459f-af22-4631c3122af2', 'volume_size': 1, 'image_id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c8b3dfe572793ca19506a261f156078', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21104eabc4634943bd4a0eb1aa24cba1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab8a371f095f74c8516a3b54543886028d11bb49d31653dca0839c3f2bd17efdd350ba1601eca53741cc52cf2fc0beef8d2f5c870e3a6a614531be4b334952c0', 'id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'created_at': datetime.datetime(2026, 8, 5, 13, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Trying to clone 98642fe1-bf36-459f-af22-4631c3122af2 from image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 1073741824" returned: 0 in 0.934s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:23 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 Aug 05 15:56:23 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:56:23 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f5fce-9c2c-4fd9-a18e-1826631129cf]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:24 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:24 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:24 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" returned: 0 in 0.580s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6331bd44-a6b6-4292-b917-62090f71de4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a8dfe0-8168-4fe3-a04b-50c90d686854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Volume volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 (0dd78f3f-c8a1-4133-bbc0-d4024e36ef28): created successfully Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a8dfe0-8168-4fe3-a04b-50c90d686854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Flow 'volume_create_manager' (2fb73f8d-d7d7-40e0-9483-90488a46f201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:24 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6a2cf824-19e8-4d80-9a6a-9bbdaf6a2d3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Created volume successfully. Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:24 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:24 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:24 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:24 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Temporary image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 is fetched for user cdc936089a16413c974e0d8a1af5bdb6. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[20873002-d5bc-4981-a055-96d446792ff1]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:25 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:25 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:25 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:25 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:25 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:25 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Creating offline snapshot a1fba7c4-0e76-49be-9202-536abd7c5246 of volume 0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4f486-51ba-4266-ad88-d6abee48c075]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:25 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 Aug 05 15:56:25 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:26 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:26 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 1G Aug 05 15:56:26 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:26 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 1G" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:26 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 Aug 05 15:56:26 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:27 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:27 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 is being set with open permissions: ugo+rw Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:27 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 Aug 05 15:56:27 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:27 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:27 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info Aug 05 15:56:27 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:27 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:27 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info is being set with open permissions: ugo+rw Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:27 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info Aug 05 15:56:27 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:27 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.info" returned: 0 in 0.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98642fe1-bf36-459f-af22-4631c3122af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21104eabc4634943bd4a0eb1aa24cba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:22Z,use_quota=True,user_id='cdc936089a16413c974e0d8a1af5bdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4627f7a-f5af-45eb-982f-ed4e6e568599),volume_type_id=f4627f7a-f5af-45eb-982f-ed4e6e568599)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Creating volume 98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:56:27 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:56:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:27 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1073741824 Aug 05 15:56:27 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-08c9959c-9c51-4dc3-8777-ff388cc13323 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Create snapshot completed successfully Aug 05 15:56:28 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1073741824" returned: 0 in 0.513s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:28 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:28 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:28 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 0 in 0.311s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Attempting download of 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}])) to volume 98642fe1-bf36-459f-af22-4631c3122af2. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c4f28-bd21-4c70-ae09-b0aa598b0041]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:29 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95 Aug 05 15:56:29 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:29 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95" returned: 0 in 0.473s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:29 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95 Aug 05 15:56:29 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "cinder-a1fba7c4-0e76-49be-9202-536abd7c5246-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-a1fba7c4-0e76-49be-9202-536abd7c5246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "cinder-quobyte-a1fba7c4-0e76-49be-9202-536abd7c5246" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-a1fba7c4-0e76-49be-9202-536abd7c5246" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Deleting offline snapshot a1fba7c4-0e76-49be-9202-536abd7c5246 of volume 0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:56:29 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] snapshot_file for this snap is: volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95" returned: 1 in 0.467s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_gq5oed95' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d98ee-e665-4dad-965b-58698c930806]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8fb61a-2e7d-446e-b31e-7953e720e093]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:30 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 Aug 05 15:56:30 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:30 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:30 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:30 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:30 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246" returned: 0 in 0.636s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec659c0-7ec7-431a-9547-9d0c9035743e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:30 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD Aug 05 15:56:30 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:30 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 Aug 05 15:56:30 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:30 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD" returned: 1 in 0.493s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 was raw, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:56:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:30 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:30 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:31 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" returned: 0 in 0.524s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:31 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 Aug 05 15:56:31 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:31 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 0 in 0.455s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f36b6d3-b8f5-4448-a70c-8002dd9b3c13_zpt7e16kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:56:31 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:31 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1G Aug 05 15:56:31 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:31 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246" returned: 0 in 0.471s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:31 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246 Aug 05 15:56:31 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:31 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 1G" returned: 0 in 0.527s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5742a30-88b3-4bba-8707-da0f60643a13]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:31 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28.a1fba7c4-0e76-49be-9202-536abd7c5246" returned: 0 in 0.389s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-a1fba7c4-0e76-49be-9202-536abd7c5246" released by "_delete_snapshot" :: held 2.212s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" released by "delete_snapshot" :: held 2.250s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:32 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:32 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Created reservations ['494eaa49-df34-418b-9020-62b080c9f45b', '5a7ade28-0d78-4a3c-a6f1-d6330d5bc026', 'af2cf35a-c05e-4ae7-abc3-88d4f95ee379', 'c25e68db-c934-41f5-89ea-63c41fd6fc1d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Delete snapshot completed successfully. Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-39ac2259-c652-40e9-8b6a-a9f3bdde1936 tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-a1fba7c4-0e76-49be-9202-536abd7c5246-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:32 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 0 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:32 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:32 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:32 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 1 in 0.444s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Downloaded image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}])) to volume 98642fe1-bf36-459f-af22-4631c3122af2 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Temporary image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 for user cdc936089a16413c974e0d8a1af5bdb6 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Marking volume 98642fe1-bf36-459f-af22-4631c3122af2 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Copying metadata from image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 to 98642fe1-bf36-459f-af22-4631c3122af2. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Creating volume glance metadata for volume 98642fe1-bf36-459f-af22-4631c3122af2 backed by image 5f36b6d3-b8f5-4448-a70c-8002dd9b3c13 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7c8b3dfe572793ca19506a261f156078', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc155cec-16ad-4efd-93a9-39a69d73ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98642fe1-bf36-459f-af22-4631c3122af2', 'volume_size': 1, 'image_id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c8b3dfe572793ca19506a261f156078', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '21104eabc4634943bd4a0eb1aa24cba1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab8a371f095f74c8516a3b54543886028d11bb49d31653dca0839c3f2bd17efdd350ba1601eca53741cc52cf2fc0beef8d2f5c870e3a6a614531be4b334952c0', 'id': '5f36b6d3-b8f5-4448-a70c-8002dd9b3c13', 'created_at': datetime.datetime(2026, 8, 5, 13, 56, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f36b6d3-b8f5-4448-a70c-8002dd9b3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d846396-edd3-4cf6-b1ea-a02e4a41700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Volume volume-98642fe1-bf36-459f-af22-4631c3122af2 (98642fe1-bf36-459f-af22-4631c3122af2): created successfully Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d846396-edd3-4cf6-b1ea-a02e4a41700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Flow 'volume_create_manager' (6fce0559-c0e0-420b-a48c-6db08be949da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ed043911-d5f5-45fe-b10a-2062b3768c38 tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Created volume successfully. Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "cinder-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619d3b5-da65-4e6f-a52a-9ff7b5db9aa3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:33 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 Aug 05 15:56:33 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:34 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" returned: 0 in 0.668s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:34 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28 Aug 05 15:56:34 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Acquiring lock "cinder-98642fe1-bf36-459f-af22-4631c3122af2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "cinder-98642fe1-bf36-459f-af22-4631c3122af2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Acquiring lock "cinder-quobyte-98642fe1-bf36-459f-af22-4631c3122af2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "cinder-quobyte-98642fe1-bf36-459f-af22-4631c3122af2" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b458842-ab4b-4f65-af84-385419797b77]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:34 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" returned: 0 in 0.508s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-quobyte-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28" released by "delete_volume" :: held 1.341s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Created reservations ['9383b839-6a95-4a46-aa05-5349f4c1ef05', '1829ff69-50fb-4743-a5a1-acfd1b5c7f31', '6ddb77a3-66fb-4038-b43d-f6f4ebbc81d3', 'eda442b8-2a61-4d3d-95dd-b96d796f08c8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:34 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:34 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:34 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:56:34 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:35 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 0 in 0.597s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:35 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Deleted volume successfully. Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9f8ab334-e1f6-4932-9824-0f3d34f749ed tempest-VolumeSnapshotQuotasNegativeTestJSON-1952684309 None] Lock "cinder-0dd78f3f-c8a1-4133-bbc0-d4024e36ef28-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:35 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:35 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:35 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 1 in 0.600s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:56:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:35 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2 Aug 05 15:56:35 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:36 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-98642fe1-bf36-459f-af22-4631c3122af2" returned: 0 in 0.487s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "cinder-quobyte-98642fe1-bf36-459f-af22-4631c3122af2" released by "delete_volume" :: held 1.787s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:36 devstack cinder-volume[88715]: WARNING cinder.quota [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:56:36 devstack cinder-volume[88715]: WARNING cinder.quota [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Created reservations ['249f7ba9-2376-49bd-a45b-02fe5f53e2d0', '55d27852-709d-4c0e-ab55-882342d2e131', '1a02f7e5-2d10-4a1a-ba58-179b5978d926', 'f757f93f-4d8d-4348-b9cf-6b9e788f655c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:36 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:56:36 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:37 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.595s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Deleted volume successfully. Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bb2a02aa-f8af-4918-bee1-83fe77228fce tempest-VolumeAndVolumeTypeFromImageTest-2088750961 None] Lock "cinder-98642fe1-bf36-459f-af22-4631c3122af2-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8d8fa038-51dc-4603-bdff-aea50ca33b59 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" by "attach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8d8fa038-51dc-4603-bdff-aea50ca33b59 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" acquired by "attach_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8d8fa038-51dc-4603-bdff-aea50ca33b59 tempest-VolumesActionsTest-1217163062 None] Attaching volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94 to instance f97974ef-44f2-4862-b693-2b5324c44cbf at mountpoint /dev/vdb on host None. Aug 05 15:56:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8d8fa038-51dc-4603-bdff-aea50ca33b59 tempest-VolumesActionsTest-1217163062 None] Attach volume completed successfully. Aug 05 15:56:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8d8fa038-51dc-4603-bdff-aea50ca33b59 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" released by "attach_volume" :: held 0.176s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-acca5b26-b0db-49b7-bb4d-5ab6cf8bc1fb tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" by "detach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-acca5b26-b0db-49b7-bb4d-5ab6cf8bc1fb tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-acca5b26-b0db-49b7-bb4d-5ab6cf8bc1fb tempest-VolumesActionsTest-1217163062 None] Detaching volume 28aa43a8-51dc-4a45-b13d-fb9f266c3d94 from instance f97974ef-44f2-4862-b693-2b5324c44cbf. Aug 05 15:56:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-acca5b26-b0db-49b7-bb4d-5ab6cf8bc1fb tempest-VolumesActionsTest-1217163062 None] Detach volume completed successfully. Aug 05 15:56:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-acca5b26-b0db-49b7-bb4d-5ab6cf8bc1fb tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Flow 'volume_create_manager' (ca6722af-d5e7-4b98-ad97-06f5be3399e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f59363-c0ce-4ba8-b5b3-20d29356aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f59363-c0ce-4ba8-b5b3-20d29356aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1938603768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f30b8-036d-4f42-9c34-2482fb4e96ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f96a6dab574b068a0ec3fde07f984a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:42Z,use_quota=True,user_id='0a47a9f9a7ae4ad996b80960f7b2f404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f29d98-4bb3-45f2-ad8d-39d49dbc85bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f29d98-4bb3-45f2-ad8d-39d49dbc85bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54088f-d2e9-406e-b568-c605b27c0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54088f-d2e9-406e-b568-c605b27c0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14f30b8-036d-4f42-9c34-2482fb4e96ec', 'volume_name': 'volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bca03c-00c7-4a9a-a537-d96ac0913773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bca03c-00c7-4a9a-a537-d96ac0913773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f2d77f-80c2-4940-8233-99df722c8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:42 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Volume c14f30b8-036d-4f42-9c34-2482fb4e96ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec', 'volume_size': 1} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1938603768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f30b8-036d-4f42-9c34-2482fb4e96ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f96a6dab574b068a0ec3fde07f984a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:42Z,use_quota=True,user_id='0a47a9f9a7ae4ad996b80960f7b2f404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Creating volume c14f30b8-036d-4f42-9c34-2482fb4e96ec {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:56:42 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:42 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec 1073741824 Aug 05 15:56:42 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:42 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec 1073741824" returned: 0 in 0.546s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:42 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec Aug 05 15:56:42 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:43 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec" returned: 0 in 0.373s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f2d77f-80c2-4940-8233-99df722c8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3eea98-4864-4f83-8f01-765bc6f6b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Volume volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec (c14f30b8-036d-4f42-9c34-2482fb4e96ec): created successfully Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3eea98-4864-4f83-8f01-765bc6f6b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Flow 'volume_create_manager' (ca6722af-d5e7-4b98-ad97-06f5be3399e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4a3f1226-5f16-41a7-a042-3674eddc1f0b tempest-AbsoluteLimitsTests-2123503076 None] Created volume successfully. Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab3dd8-5317-401c-96dd-79330f4076a8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (3804cc85-2ce5-4e9f-98f5-f13d59f74797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9fcfa5-df5d-4b78-b5a5-6841463a5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9fcfa5-df5d-4b78-b5a5-6841463a5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387870381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794e2989-a511-4bd8-9ab9-290795d13515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:44Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e4b76-f7b7-40a4-986b-7287e6625f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e4b76-f7b7-40a4-986b-7287e6625f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1440932-86f1-4524-bc60-5a8b36e91c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1440932-86f1-4524-bc60-5a8b36e91c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794e2989-a511-4bd8-9ab9-290795d13515', 'volume_name': 'volume-794e2989-a511-4bd8-9ab9-290795d13515', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278d0afa-55e0-4747-b2ea-504741e40c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278d0afa-55e0-4747-b2ea-504741e40c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:44 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:56:44 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06650712-b6e2-478d-8f49-a15af8c24078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:44 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume 794e2989-a511-4bd8-9ab9-290795d13515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794e2989-a511-4bd8-9ab9-290795d13515', 'volume_size': 1} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:44 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Acquiring lock "cinder-c14f30b8-036d-4f42-9c34-2482fb4e96ec-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "cinder-c14f30b8-036d-4f42-9c34-2482fb4e96ec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4332f3-e246-440b-b63e-fe0aec657467]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Acquiring lock "cinder-quobyte-c14f30b8-036d-4f42-9c34-2482fb4e96ec" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "cinder-quobyte-c14f30b8-036d-4f42-9c34-2482fb4e96ec" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd1220-6ce4-42f2-8180-6e34196c7054]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:44 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:56:44 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:44 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec Aug 05 15:56:44 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:44 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.401s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.8d3754ca-ae5c-47d6-bbb3-b8d750401ef01uftmqd4.img {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:44 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.8d3754ca-ae5c-47d6-bbb3-b8d750401ef01uftmqd4.img Aug 05 15:56:44 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:45 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec" returned: 0 in 0.397s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:45 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec Aug 05 15:56:45 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:45 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c14f30b8-036d-4f42-9c34-2482fb4e96ec" returned: 0 in 0.398s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "cinder-quobyte-c14f30b8-036d-4f42-9c34-2482fb4e96ec" released by "delete_volume" :: held 0.858s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Created reservations ['d269ee41-6b6c-4805-b309-041ab0e2190c', 'e424037d-a577-49dd-9125-96903df1c128', 'f9cee1cf-63c6-4d97-adab-f4cca94b6989', '7358f98c-2648-4a44-805e-3247c16451c4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:45 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:56:45 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:46 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.778s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Deleted volume successfully. Aug 05 15:56:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e431ac95-f459-4d78-85dc-597ebe106349 tempest-AbsoluteLimitsTests-2123503076 None] Lock "cinder-c14f30b8-036d-4f42-9c34-2482fb4e96ec-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:50 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.8d3754ca-ae5c-47d6-bbb3-b8d750401ef01uftmqd4.img" returned: 0 in 5.724s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d33041-9dd5-4fe3-8134-b7db2739a988]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:50 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:56:50 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:51 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.614s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:51 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.8d3754ca-ae5c-47d6-bbb3-b8d750401ef01uftmqd4.img {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:56:51 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Converted 1024.00 MB image at 178.86 MB/s Aug 05 15:56:51 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] 8d3754ca-ae5c-47d6-bbb3-b8d750401ef0 was raw, no need to convert to raw {{(pid=88715) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Flow 'volume_create_manager' (9a29add7-5bf2-4e9f-a1a2-e8d25f00a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73dfc959-2625-48fb-a32a-ab3c0c800916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73dfc959-2625-48fb-a32a-ab3c0c800916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1176909383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce49568c-5404-4f1c-93cc-5987faed9bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c3a4ed6894296a178a45c313965a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:55Z,use_quota=True,user_id='85afbe8308e448798ce40e533cdfd75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae4c4ae-dffd-4f18-a386-af9667c4ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae4c4ae-dffd-4f18-a386-af9667c4ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c5176-d87d-4bb9-86fe-ac52974edb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2c5176-d87d-4bb9-86fe-ac52974edb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce49568c-5404-4f1c-93cc-5987faed9bd2', 'volume_name': 'volume-ce49568c-5404-4f1c-93cc-5987faed9bd2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f2fc43-28ec-4ca2-9699-c306dfc8948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f2fc43-28ec-4ca2-9699-c306dfc8948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d145b2f-bae2-473c-bd14-4d86916a36f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:55 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Volume ce49568c-5404-4f1c-93cc-5987faed9bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce49568c-5404-4f1c-93cc-5987faed9bd2', 'volume_size': 1} Aug 05 15:56:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:03 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:03 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:03 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:57:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:57:05 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=58,cinder:DELETE=6 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:57:05 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=58,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.084s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Uploaded volume to glance image-id: 8d3754ca-ae5c-47d6-bbb3-b8d750401ef0. {{(pid=88715) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.927s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387870381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794e2989-a511-4bd8-9ab9-290795d13515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:44Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume 794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:13 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:13 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 1073741824 Aug 05 15:57:13 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e4abbe29-2014-4e31-b4ab-799b34b06b10 tempest-VolumesActionsTest-1217163062 None] Copy volume to image completed successfully. Aug 05 15:57:13 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 1073741824" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:13 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 Aug 05 15:57:13 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:13 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515" returned: 0 in 0.283s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.412s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1176909383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce49568c-5404-4f1c-93cc-5987faed9bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c3a4ed6894296a178a45c313965a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:55Z,use_quota=True,user_id='85afbe8308e448798ce40e533cdfd75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Creating volume ce49568c-5404-4f1c-93cc-5987faed9bd2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:14 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06650712-b6e2-478d-8f49-a15af8c24078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794e2989-a511-4bd8-9ab9-290795d13515', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2539529d-7326-4299-963f-58db545d4495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:14 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 1073741824 Aug 05 15:57:14 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-794e2989-a511-4bd8-9ab9-290795d13515 (794e2989-a511-4bd8-9ab9-290795d13515): created successfully Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2539529d-7326-4299-963f-58db545d4495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (3804cc85-2ce5-4e9f-98f5-f13d59f74797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e0ea0530-04fe-43de-9f05-4ffd7173b8f7 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:14 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 1073741824" returned: 0 in 0.518s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:14 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 Aug 05 15:57:14 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:14 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2" returned: 0 in 0.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.373s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d145b2f-bae2-473c-bd14-4d86916a36f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce49568c-5404-4f1c-93cc-5987faed9bd2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c566903-47e5-41d2-b095-4d8399f4c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01bce3c-52a3-43b2-87c7-cca07beb8d5e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Volume volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 (ce49568c-5404-4f1c-93cc-5987faed9bd2): created successfully Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c566903-47e5-41d2-b095-4d8399f4c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Flow 'volume_create_manager' (9a29add7-5bf2-4e9f-a1a2-e8d25f00a93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1f5023a6-029f-4363-9bc1-c13745696231 tempest-VolumesTransfersV355Test-439012980 None] Created volume successfully. Aug 05 15:57:15 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:57:15 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:15 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.501s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fa5657-66ba-4bcd-a329-3ee19bc4d3ee]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:15 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:57:15 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:15 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.489s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:15 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img Aug 05 15:57:15 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-90b39563-96ef-43a9-bcdc-54f992b1322e tempest-VolumesTransfersV355Test-1677277129 None] Transfer volume completed successfully. Aug 05 15:57:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "cinder-ce49568c-5404-4f1c-93cc-5987faed9bd2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-ce49568c-5404-4f1c-93cc-5987faed9bd2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "cinder-quobyte-ce49568c-5404-4f1c-93cc-5987faed9bd2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-quobyte-ce49568c-5404-4f1c-93cc-5987faed9bd2" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:19 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0a9a5-844d-4dd1-a724-9efef47a8beb]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:19 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 Aug 05 15:57:19 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:19 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2" returned: 0 in 0.647s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:19 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2 Aug 05 15:57:19 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:20 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ce49568c-5404-4f1c-93cc-5987faed9bd2" returned: 0 in 0.534s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-quobyte-ce49568c-5404-4f1c-93cc-5987faed9bd2" released by "delete_volume" :: held 1.286s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Created reservations ['8bac958a-3084-4c69-91d8-18410e8d999f', 'ef67212e-0eeb-4a59-b16f-a2ec301bc58a', '69adcdcc-60f0-4445-8f31-004817cac254', '57923e23-92cc-4a02-bef4-d8403a7453d4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:20 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:20 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:21 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.553s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Deleted volume successfully. Aug 05 15:57:21 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img" returned: 0 in 5.394s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59339e-c4cf-495f-b3b5-9b8057b13bfb]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7944694c-d2ae-4944-bf07-009534b49b1e tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-ce49568c-5404-4f1c-93cc-5987faed9bd2-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:21 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:57:21 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:22 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.702s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:57:22 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Converted 1024.00 MB image at 189.80 MB/s Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] 1b1b63b7-6d90-4971-9880-966b02f8b4e0 was raw, converting to qcow2 {{(pid=88715) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a979a-79b9-42a2-b133-36920dbb46a2]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Flow 'volume_create_manager' (61f3858b-494f-4ba5-84a4-8c99264a5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d35207e-6552-4354-8b27-71702d3df99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d35207e-6552-4354-8b27-71702d3df99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015061886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02acb586-1e2b-44ea-a36d-e2f2834b2256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c3a4ed6894296a178a45c313965a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:22Z,use_quota=True,user_id='85afbe8308e448798ce40e533cdfd75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf64b29-f599-4d98-983c-446fe0db2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf64b29-f599-4d98-983c-446fe0db2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a4a84-8933-4b5e-8c1d-14c19b844898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2a4a84-8933-4b5e-8c1d-14c19b844898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02acb586-1e2b-44ea-a36d-e2f2834b2256', 'volume_name': 'volume-02acb586-1e2b-44ea-a36d-e2f2834b2256', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa5b13e-afda-415f-a7b1-ba223a30c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa5b13e-afda-415f-a7b1-ba223a30c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc4e43-7575-4828-8eac-6a5f49d23bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Volume 02acb586-1e2b-44ea-a36d-e2f2834b2256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02acb586-1e2b-44ea-a36d-e2f2834b2256', 'volume_size': 1} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:22 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img Aug 05 15:57:22 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:22 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img" returned: 0 in 0.394s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:22 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img Aug 05 15:57:22 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:22 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img" returned: 1 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:57:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_ {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:22 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_ Aug 05 15:57:22 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:23 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_" returned: 0 in 0.265s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:23 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Image conversion details: src /opt/stack/data/cinder/conversion/28aa43a8-51dc-4a45-b13d-fb9f266c3d94.temp_image.1b1b63b7-6d90-4971-9880-966b02f8b4e0dp0weeq2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_ {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:57:23 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 05 15:57:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be6527-b6f5-42d1-8cd0-e3cb5c96785b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_ {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:23 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_ Aug 05 15:57:23 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:23 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bie1sh6_" returned: 0 in 0.347s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.506s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Uploaded volume to glance image-id: 1b1b63b7-6d90-4971-9880-966b02f8b4e0. {{(pid=88715) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.069s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5c5e0220-41e1-4d6e-8bef-064e908b2ec0 tempest-VolumesActionsTest-1217163062 None] Copy volume to image completed successfully. Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating offline snapshot c827f240-ba24-49f5-a1fe-0482a4632feb of volume 794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b04461-ba8e-4e8e-a514-7ed07fdbb94c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:25 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 Aug 05 15:57:25 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:25 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:25 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb 1G Aug 05 15:57:25 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:26 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb 1G" returned: 0 in 0.472s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794e2989-a511-4bd8-9ab9-290795d13515 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:26 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794e2989-a511-4bd8-9ab9-290795d13515 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb Aug 05 15:57:26 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:26 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794e2989-a511-4bd8-9ab9-290795d13515 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb" returned: 0 in 0.395s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:26 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb is being set with open permissions: ugo+rw Aug 05 15:57:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:26 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb Aug 05 15:57:26 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:27 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb" returned: 0 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:27 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info Aug 05 15:57:27 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "cinder-quobyte-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:27 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info" returned: 0 in 0.432s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:27 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info is being set with open permissions: ugo+rw Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-quobyte-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" acquired by "delete_volume" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:27 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info Aug 05 15:57:27 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b1e344-6c73-4c78-bc74-4d15577a1c29]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:27 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:57:27 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:27 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.info" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.806s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2015061886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02acb586-1e2b-44ea-a36d-e2f2834b2256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39c3a4ed6894296a178a45c313965a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:22Z,use_quota=True,user_id='85afbe8308e448798ce40e533cdfd75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Creating volume 02acb586-1e2b-44ea-a36d-e2f2834b2256 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:28 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:28 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 1073741824 Aug 05 15:57:28 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7f7d68f4-3170-4c67-b85c-9a801fbd70f5 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Create snapshot completed successfully Aug 05 15:57:28 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.457s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:28 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94 Aug 05 15:57:28 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:28 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" returned: 0 in 0.308s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-quobyte-28aa43a8-51dc-4a45-b13d-fb9f266c3d94" released by "delete_volume" :: held 0.809s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:28 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 1073741824" returned: 0 in 0.543s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Created reservations ['c6ec053a-6124-4b6a-9acf-fb7b5f04e637', 'b830b0a8-6b47-491b-ba1c-1bc2453bcee9', 'c1c467a7-cccd-4d8f-b789-fedfced83236', '54230acc-7b5c-4fb7-bc0b-e4d649247a3a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:28 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 Aug 05 15:57:28 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:28 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:28 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:29 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc4e43-7575-4828-8eac-6a5f49d23bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02acb586-1e2b-44ea-a36d-e2f2834b2256', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad8193c-5d88-43c0-a9da-32f8d6a23155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Volume volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 (02acb586-1e2b-44ea-a36d-e2f2834b2256): created successfully Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad8193c-5d88-43c0-a9da-32f8d6a23155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Flow 'volume_create_manager' (61f3858b-494f-4ba5-84a4-8c99264a5da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:29 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.520s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-246d80ce-9cbf-487f-a4cf-93ca6b036ff6 tempest-VolumesTransfersV355Test-439012980 None] Created volume successfully. Aug 05 15:57:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Deleted volume successfully. Aug 05 15:57:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-596b5563-7a6d-4afa-ad05-23a2ea5405f0 tempest-VolumesActionsTest-1217163062 None] Lock "cinder-28aa43a8-51dc-4a45-b13d-fb9f266c3d94-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (86e9f83d-4b23-4648-9d1a-930e757186d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2c71a8-e382-4da7-9e43-afc665cb9955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2c71a8-e382-4da7-9e43-afc665cb9955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726404085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46e7ae0-66da-481d-88f9-95e2b0643036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:30Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c010590-7f9c-42f3-b82c-6ff863d162ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c010590-7f9c-42f3-b82c-6ff863d162ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdac514f-ab8f-453f-a3c2-85ad05761130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdac514f-ab8f-453f-a3c2-85ad05761130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46e7ae0-66da-481d-88f9-95e2b0643036', 'volume_name': 'volume-a46e7ae0-66da-481d-88f9-95e2b0643036', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f9a62-f304-4a3a-a01f-fc4b0c024386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f9a62-f304-4a3a-a01f-fc4b0c024386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5b2742-1839-42af-9a54-ba8237575cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume a46e7ae0-66da-481d-88f9-95e2b0643036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46e7ae0-66da-481d-88f9-95e2b0643036', 'volume_size': 1} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726404085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46e7ae0-66da-481d-88f9-95e2b0643036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:30Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume a46e7ae0-66da-481d-88f9-95e2b0643036 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:30 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:30 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 1073741824 Aug 05 15:57:30 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (60eb3c71-db1b-4c54-b90c-1a1ef9f42ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70c26ab-4fc2-4dc1-9e98-749c6c8a2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70c26ab-4fc2-4dc1-9e98-749c6c8a2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2037259534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86adc78-e5de-40d6-a5b6-660f307345b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:30Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc0a7cb-0eb4-484c-abfc-5ba554dc53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc0a7cb-0eb4-484c-abfc-5ba554dc53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee03bac-9ac5-42e4-9c29-32d7ad5b9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee03bac-9ac5-42e4-9c29-32d7ad5b9b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86adc78-e5de-40d6-a5b6-660f307345b8', 'volume_name': 'volume-a86adc78-e5de-40d6-a5b6-660f307345b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765408a-edcf-4ee6-9239-42d58934bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765408a-edcf-4ee6-9239-42d58934bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fb8340-532e-423a-b992-13128b69817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Volume a86adc78-e5de-40d6-a5b6-660f307345b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86adc78-e5de-40d6-a5b6-660f307345b8', 'volume_size': 1} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "cinder-02acb586-1e2b-44ea-a36d-e2f2834b2256-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-02acb586-1e2b-44ea-a36d-e2f2834b2256-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "cinder-quobyte-02acb586-1e2b-44ea-a36d-e2f2834b2256" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-quobyte-02acb586-1e2b-44ea-a36d-e2f2834b2256" acquired by "delete_volume" :: waited 0.056s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3479b16-6850-426a-adb9-0c108749b502]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:30 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (dde53290-c80f-4ded-8b4e-6065e307c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a99c9da-e3c6-4efd-990e-c59d4f1cbb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 1073741824" returned: 0 in 0.809s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a99c9da-e3c6-4efd-990e-c59d4f1cbb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025500920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa19524b-7c45-41b9-a2df-286ffd2c8f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:31Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cff11f-1739-4cca-a163-a3bb5f851d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cff11f-1739-4cca-a163-a3bb5f851d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a10ae9-6ec9-47f9-a04c-d2f3b21cb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a10ae9-6ec9-47f9-a04c-d2f3b21cb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa19524b-7c45-41b9-a2df-286ffd2c8f32', 'volume_name': 'volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f29c45e-d6d3-4cc4-bb9d-b91e4e7d7644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f29c45e-d6d3-4cc4-bb9d-b91e4e7d7644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a48335-4850-4526-b5f0-21819307addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:31 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume aa19524b-7c45-41b9-a2df-286ffd2c8f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32', 'volume_size': 1} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:31 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 Aug 05 15:57:31 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:31 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 Aug 05 15:57:31 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:31 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036" returned: 0 in 0.329s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2037259534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86adc78-e5de-40d6-a5b6-660f307345b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:30Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Creating volume a86adc78-e5de-40d6-a5b6-660f307345b8 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:31 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:31 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 1073741824 Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5b2742-1839-42af-9a54-ba8237575cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46e7ae0-66da-481d-88f9-95e2b0643036', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:31 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88db36f5-5aaf-43b8-bbe8-e5e1bde7ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:31 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-a46e7ae0-66da-481d-88f9-95e2b0643036 (a46e7ae0-66da-481d-88f9-95e2b0643036): created successfully Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88db36f5-5aaf-43b8-bbe8-e5e1bde7ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (86e9f83d-4b23-4648-9d1a-930e757186d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-88f55f3a-281f-4f92-9545-885ee6a8aa12 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:31 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256" returned: 0 in 0.865s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:31 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256 Aug 05 15:57:31 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (573428a0-b48e-4fc5-9316-d3ca950de56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e829be45-d9de-4d85-97c4-2253cff7801d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e829be45-d9de-4d85-97c4-2253cff7801d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165768284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9f9dd1-0ef0-450b-98a7-215fb391b36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:32Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a3ed07-7f03-493c-ab15-f4b7a22b2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a3ed07-7f03-493c-ab15-f4b7a22b2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1162e8-f1b7-4629-9fd5-0e5c2ebb322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1162e8-f1b7-4629-9fd5-0e5c2ebb322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9f9dd1-0ef0-450b-98a7-215fb391b36e', 'volume_name': 'volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f551c64d-1a09-4a50-9f97-58a6107607a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f551c64d-1a09-4a50-9f97-58a6107607a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a842e63b-426b-4b2e-b7b0-54feb032f5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume 6b9f9dd1-0ef0-450b-98a7-215fb391b36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e', 'volume_size': 1} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:32 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (7149ba50-1d7e-4653-80b2-15becd00a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:32 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5034229-68f0-45c1-a7de-01f962ab759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 1073741824" returned: 0 in 1.034s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02acb586-1e2b-44ea-a36d-e2f2834b2256" returned: 0 in 0.736s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-quobyte-02acb586-1e2b-44ea-a36d-e2f2834b2256" released by "delete_volume" :: held 1.690s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5034229-68f0-45c1-a7de-01f962ab759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123797064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321fd110-5e42-44b3-8051-5abc932d1efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:32Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6bfa8-8b15-41a6-955a-7c19a8533aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6bfa8-8b15-41a6-955a-7c19a8533aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f139705f-837f-407a-a1f4-5b097b3cece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f139705f-837f-407a-a1f4-5b097b3cece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321fd110-5e42-44b3-8051-5abc932d1efd', 'volume_name': 'volume-321fd110-5e42-44b3-8051-5abc932d1efd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f46fe1-f852-455b-9f4c-ad3f7924216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f46fe1-f852-455b-9f4c-ad3f7924216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b6e876-0943-46b0-99a7-01bffc85d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:32 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume 321fd110-5e42-44b3-8051-5abc932d1efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321fd110-5e42-44b3-8051-5abc932d1efd', 'volume_size': 1} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:32 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 Aug 05 15:57:32 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Created reservations ['61984d84-acfa-4e8e-89ee-f680858d2f61', '5d6f4ba0-b67e-45ec-ba1b-9c1d49845660', '6702783b-8728-4e1f-9077-5b5935314fa9', 'eff081a5-789f-45d8-bb87-cc2d24ae9b12'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:32 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:32 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:32 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025500920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa19524b-7c45-41b9-a2df-286ffd2c8f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:31Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume aa19524b-7c45-41b9-a2df-286ffd2c8f32 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:32 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:33 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 1073741824 Aug 05 15:57:33 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fb8340-532e-423a-b992-13128b69817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86adc78-e5de-40d6-a5b6-660f307345b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a2d31a-0489-4da3-9bc8-73bf5af2a2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Volume volume-a86adc78-e5de-40d6-a5b6-660f307345b8 (a86adc78-e5de-40d6-a5b6-660f307345b8): created successfully Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a2d31a-0489-4da3-9bc8-73bf5af2a2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (60eb3c71-db1b-4c54-b90c-1a1ef9f42ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (c5c1bfe2-b76b-4b6f-816e-7ab89b2977a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8b6af5-2a56-498c-8bb5-0e330611c05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-50805335-0e96-41c9-8478-153af8268030 tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8b6af5-2a56-498c-8bb5-0e330611c05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328573200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:33Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638ebac2-fb16-4112-9026-0ac8069f2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638ebac2-fb16-4112-9026-0ac8069f2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0afef4-600f-4316-a48d-a8159561ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0afef4-600f-4316-a48d-a8159561ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e', 'volume_name': 'volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f0938d-b077-4996-a6c6-45d49903db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f0938d-b077-4996-a6c6-45d49903db7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c96a0c-aee1-4496-8b55-8284994e412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume 9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e', 'volume_size': 1} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:33 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.564s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Deleted volume successfully. Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8930a89e-7da5-4153-97d4-241d73f78b19 tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8" by "attach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc884654-104e-427a-bb61-eeaba44c9cbb tempest-VolumesTransfersV355Test-797916033 None] Lock "cinder-02acb586-1e2b-44ea-a36d-e2f2834b2256-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8930a89e-7da5-4153-97d4-241d73f78b19 tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8" acquired by "attach_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8930a89e-7da5-4153-97d4-241d73f78b19 tempest-VolumesActionsTest-755011188 None] Attaching volume a86adc78-e5de-40d6-a5b6-660f307345b8 to instance ceab755f-9510-4037-ba73-b7ee6fa3b8b0 at mountpoint /dev/vdb on host None. Aug 05 15:57:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8930a89e-7da5-4153-97d4-241d73f78b19 tempest-VolumesActionsTest-755011188 None] Attach volume completed successfully. Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-8930a89e-7da5-4153-97d4-241d73f78b19 tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8" released by "attach_volume" :: held 0.183s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:33 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 1073741824" returned: 0 in 0.771s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:33 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 Aug 05 15:57:33 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:34 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32" returned: 0 in 0.506s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.154s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165768284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9f9dd1-0ef0-450b-98a7-215fb391b36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:32Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume 6b9f9dd1-0ef0-450b-98a7-215fb391b36e {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:34 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a48335-4850-4526-b5f0-21819307addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:34 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e 1073741824 Aug 05 15:57:34 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af94a4b-3551-4496-a953-5bdc0684aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 (aa19524b-7c45-41b9-a2df-286ffd2c8f32): created successfully Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af94a4b-3551-4496-a953-5bdc0684aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (dde53290-c80f-4ded-8b4e-6065e307c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-060ba255-347a-4653-98b7-8d34ffe65b5d tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Terminate volume connection completed successfully. Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" by "detach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Detaching volume a86adc78-e5de-40d6-a5b6-660f307345b8 from instance ceab755f-9510-4037-ba73-b7ee6fa3b8b0. Aug 05 15:57:35 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Detach volume completed successfully. Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e 1073741824" returned: 0 in 0.722s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-040e9ae6-f7ce-4c3b-bd5f-4c95557a0922 tempest-VolumesActionsTest-929851242 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:35 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e Aug 05 15:57:35 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1f121039-8bab-4d7a-adb0-70a0a750488f tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" by "detach_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1f121039-8bab-4d7a-adb0-70a0a750488f tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1f121039-8bab-4d7a-adb0-70a0a750488f tempest-VolumesActionsTest-755011188 None] Volume detach called, but volume not attached. Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1f121039-8bab-4d7a-adb0-70a0a750488f tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:35 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" returned: 0 in 0.479s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123797064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321fd110-5e42-44b3-8051-5abc932d1efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:32Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume 321fd110-5e42-44b3-8051-5abc932d1efd {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:35 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:35 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd 1073741824 Aug 05 15:57:35 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a842e63b-426b-4b2e-b7b0-54feb032f5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9be9fc-5711-44c6-ac49-9aca50aaa803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e (6b9f9dd1-0ef0-450b-98a7-215fb391b36e): created successfully Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9be9fc-5711-44c6-ac49-9aca50aaa803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (573428a0-b48e-4fc5-9316-d3ca950de56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:36 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9ad8fe6f-f3bc-42df-8ac1-8480284c060e tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-quobyte-a86adc78-e5de-40d6-a5b6-660f307345b8" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "cinder-quobyte-a86adc78-e5de-40d6-a5b6-660f307345b8" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a122429-4ede-473c-b73a-c7b27a1a1062]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:36 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 Aug 05 15:57:36 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:36 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd 1073741824" returned: 0 in 1.140s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:36 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8" returned: 0 in 0.650s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:36 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8 Aug 05 15:57:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:36 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:37 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd Aug 05 15:57:37 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:37 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a86adc78-e5de-40d6-a5b6-660f307345b8" returned: 0 in 0.548s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:37 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd" returned: 0 in 0.533s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "cinder-quobyte-a86adc78-e5de-40d6-a5b6-660f307345b8" released by "delete_volume" :: held 1.319s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.137s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328573200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5202e1f1284160a5041f59ba3a9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:33Z,use_quota=True,user_id='2c818c675a274660895a510f229cc0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Creating volume 9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:37 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b6e876-0943-46b0-99a7-01bffc85d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321fd110-5e42-44b3-8051-5abc932d1efd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b7c9b8-365e-449a-9e9c-b40bd6e63484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:37 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e 1073741824 Aug 05 15:57:37 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:37 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-321fd110-5e42-44b3-8051-5abc932d1efd (321fd110-5e42-44b3-8051-5abc932d1efd): created successfully Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b7c9b8-365e-449a-9e9c-b40bd6e63484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (7149ba50-1d7e-4653-80b2-15becd00a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-786da4f5-ac22-4403-aa6a-f4b6aec54931 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Created reservations ['61dbad15-5b59-4320-944e-29ade4ab450d', '28d7b450-6025-43c3-b716-decc8acbfb47', '11531b9c-25ef-4e7c-970a-ca309136a1dd', 'd06669a6-f15e-4b50-b107-471dbbb85137'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:37 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:37 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:38 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.423s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Deleted volume successfully. Aug 05 15:57:38 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e 1073741824" returned: 0 in 0.883s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-306adeb7-e18b-442f-bd9a-a0b3e9886d9b tempest-VolumesActionsTest-755011188 None] Lock "cinder-a86adc78-e5de-40d6-a5b6-660f307345b8-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:38 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e Aug 05 15:57:38 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:38 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" returned: 0 in 0.428s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c96a0c-aee1-4496-8b55-8284994e412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbc6341-b589-4459-925e-476f6dcbb8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:38 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Volume volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e (9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e): created successfully Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbc6341-b589-4459-925e-476f6dcbb8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:38 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Flow 'volume_create_manager' (c5c1bfe2-b76b-4b6f-816e-7ab89b2977a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-422e8ae5-6026-4f96-a9fc-aee25a222b67 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created volume successfully. Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9634b-2ad5-46dd-b738-d2d23ca5e2fa]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:40 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e Aug 05 15:57:40 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:40 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" returned: 0 in 0.544s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:40 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e Aug 05 15:57:40 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:41 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" returned: 0 in 0.408s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e" released by "delete_volume" :: held 1.029s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['2170e4e4-f252-4694-9ad2-9b99e6054474', '69e40b39-40f2-41bb-b2e9-7e0b56560c1d', 'a313027f-2ee2-4875-993f-9093d88b9a7b', 'e41c92cc-3df4-4bf5-9f77-65a5cd8ebc57'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:41 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:41 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:41 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.321s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da93b82d-31a6-4aa1-892b-16f993970e95 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-9bbbaa60-a4c1-4463-a3ad-454d1fd7bb7e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Flow 'volume_create_manager' (16a9285e-4f49-4f5d-bc10-53b830e81a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3b00f-5821-40be-864b-b7ed081f0398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3b00f-5821-40be-864b-b7ed081f0398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-960880219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc15a794-b24a-4c80-8819-1328df6581fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4f3b439474d3a95c5da621282ae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:42Z,use_quota=True,user_id='74e429c7c028439e82d39b4068453264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391541c4-ef3a-49b3-a422-b30352f1c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391541c4-ef3a-49b3-a422-b30352f1c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6351db-4375-4cfe-ac87-af31de54bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-321fd110-5e42-44b3-8051-5abc932d1efd-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-321fd110-5e42-44b3-8051-5abc932d1efd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-321fd110-5e42-44b3-8051-5abc932d1efd" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (2e721645-7b24-42f9-ae2a-981e50dcf333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cb0b46-3b0c-4e98-b583-c42d162bc113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-321fd110-5e42-44b3-8051-5abc932d1efd" acquired by "delete_volume" :: waited 0.058s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cb0b46-3b0c-4e98-b583-c42d162bc113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1775703797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c313d9dc-0141-42b6-b5c7-637a34447b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:43Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4776328f-2478-45d0-a843-3c1ab64858e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4776328f-2478-45d0-a843-3c1ab64858e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f0c8e7-dfbe-4bab-90db-5a7dc68459c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f0c8e7-dfbe-4bab-90db-5a7dc68459c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c313d9dc-0141-42b6-b5c7-637a34447b90', 'volume_name': 'volume-c313d9dc-0141-42b6-b5c7-637a34447b90', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7c4c3e-bd93-42e5-8e1a-d3ea79bed994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7c4c3e-bd93-42e5-8e1a-d3ea79bed994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09bd89-8cda-448e-902e-84ed7ab97566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:42 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Volume c313d9dc-0141-42b6-b5c7-637a34447b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c313d9dc-0141-42b6-b5c7-637a34447b90', 'volume_size': 1} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1775703797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c313d9dc-0141-42b6-b5c7-637a34447b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:43Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Creating volume c313d9dc-0141-42b6-b5c7-637a34447b90 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:42 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0cdb2d-3111-4e7f-a190-d4baa919abb8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:42 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 1073741824 Aug 05 15:57:42 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:42 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd Aug 05 15:57:42 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Flow 'volume_create_manager' (d6a9ec0f-0c6d-4e01-9e92-656b6b910d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3a6f5c-e6c5-4985-a015-8b0b187b0df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3a6f5c-e6c5-4985-a015-8b0b187b0df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1136768271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75426f36-e7c2-4314-8d78-339b88c52b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1a25551f054ef789d0c9f6d27f78d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:43Z,use_quota=True,user_id='bacb8213eab74c31a1e8c2d44d3c910a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42753fd-8056-4af0-b6aa-22e8444dcf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42753fd-8056-4af0-b6aa-22e8444dcf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb061189-689c-43aa-bc79-44bc80674002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb061189-689c-43aa-bc79-44bc80674002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75426f36-e7c2-4314-8d78-339b88c52b14', 'volume_name': 'volume-75426f36-e7c2-4314-8d78-339b88c52b14', 'volume_size': 2}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da8629-7229-4852-b327-8893674376a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da8629-7229-4852-b327-8893674376a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe79afa-aadd-47a7-a4eb-9e7432bae50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Volume 75426f36-e7c2-4314-8d78-339b88c52b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75426f36-e7c2-4314-8d78-339b88c52b14', 'volume_size': 2} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6351db-4375-4cfe-ac87-af31de54bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc15a794-b24a-4c80-8819-1328df6581fa', 'volume_name': 'volume-bc15a794-b24a-4c80-8819-1328df6581fa', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229e01f5-cb97-47d0-932d-ea0e09e2d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229e01f5-cb97-47d0-932d-ea0e09e2d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69f245-ae47-4cf2-b288-d3261105e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Volume bc15a794-b24a-4c80-8819-1328df6581fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc15a794-b24a-4c80-8819-1328df6581fa', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Trying to clone bc15a794-b24a-4c80-8819-1328df6581fa from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:57:43 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:43 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd Aug 05 15:57:43 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:43 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 1073741824" returned: 0 in 0.502s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:43 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 Aug 05 15:57:43 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:43 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-321fd110-5e42-44b3-8051-5abc932d1efd" returned: 0 in 0.318s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-321fd110-5e42-44b3-8051-5abc932d1efd" released by "delete_volume" :: held 0.841s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4276c4-eb0b-48ab-9fdc-f978e3df668e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['f605dd21-fe28-4405-b238-abefdfe867d5', 'a80577bc-bdd3-4322-bacb-44e4814b7f51', 'aac4ffb5-d284-4b4b-a41f-23396431fa79', '3ea37f01-7bd2-4af0-b6d7-80f97c2cab83'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:43 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1136768271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75426f36-e7c2-4314-8d78-339b88c52b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1a25551f054ef789d0c9f6d27f78d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:43Z,use_quota=True,user_id='bacb8213eab74c31a1e8c2d44d3c910a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Creating volume 75426f36-e7c2-4314-8d78-339b88c52b14 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:43 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD Aug 05 15:57:43 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:43 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:43 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 2147483648 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09bd89-8cda-448e-902e-84ed7ab97566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c313d9dc-0141-42b6-b5c7-637a34447b90', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c8eebb-f49a-420a-b24f-576d7484de38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:43 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 2147483648 Aug 05 15:57:43 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Volume volume-c313d9dc-0141-42b6-b5c7-637a34447b90 (c313d9dc-0141-42b6-b5c7-637a34447b90): created successfully Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c8eebb-f49a-420a-b24f-576d7484de38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (2e721645-7b24-42f9-ae2a-981e50dcf333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7fef30fb-5213-4ce8-bf19-c797f1ccfc99 tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:57:43 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:43 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad is fetched for user 74e429c7c028439e82d39b4068453264. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:57:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e6dc6d-e04d-4ffa-8840-8501a6a95eda tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-321fd110-5e42-44b3-8051-5abc932d1efd-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e2911-764f-446e-b92c-e29d28673e52]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:44 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD Aug 05 15:57:44 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:44 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 2147483648" returned: 0 in 0.522s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:44 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 Aug 05 15:57:44 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:44 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:44 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14" returned: 0 in 0.237s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-960880219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc15a794-b24a-4c80-8819-1328df6581fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4f3b439474d3a95c5da621282ae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:42Z,use_quota=True,user_id='74e429c7c028439e82d39b4068453264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Creating volume bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:44 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:44 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1073741824 Aug 05 15:57:44 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe79afa-aadd-47a7-a4eb-9e7432bae50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75426f36-e7c2-4314-8d78-339b88c52b14', 'volume_size': 2}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30658c5-0928-4c6f-b47a-6f286b6c0949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:44 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Volume volume-75426f36-e7c2-4314-8d78-339b88c52b14 (75426f36-e7c2-4314-8d78-339b88c52b14): created successfully Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30658c5-0928-4c6f-b47a-6f286b6c0949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Flow 'volume_create_manager' (d6a9ec0f-0c6d-4e01-9e92-656b6b910d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bc90c903-74a9-455d-b8ee-458b3105ce00 tempest-VolumesCloneNegativeTest-316284092 None] Created volume successfully. Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-6b9f9dd1-0ef0-450b-98a7-215fb391b36e-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-6b9f9dd1-0ef0-450b-98a7-215fb391b36e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-c313d9dc-0141-42b6-b5c7-637a34447b90-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "cinder-c313d9dc-0141-42b6-b5c7-637a34447b90-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00b890-c350-4f3a-aa84-2fc6d61bfab0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-quobyte-c313d9dc-0141-42b6-b5c7-637a34447b90" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-c313d9dc-0141-42b6-b5c7-637a34447b90" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f474e-2a58-4a69-a82c-7a4b0a22d850]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e Aug 05 15:57:45 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1073741824" returned: 0 in 0.541s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:45 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 Aug 05 15:57:45 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Acquiring lock "cinder-75426f36-e7c2-4314-8d78-339b88c52b14-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "cinder-75426f36-e7c2-4314-8d78-339b88c52b14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Acquiring lock "cinder-quobyte-75426f36-e7c2-4314-8d78-339b88c52b14" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "cinder-quobyte-75426f36-e7c2-4314-8d78-339b88c52b14" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:45 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" returned: 0 in 0.445s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d340360-fb87-4cb9-b0ec-4972af2320fc]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e Aug 05 15:57:45 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 0.316s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Attempting download of 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume bc15a794-b24a-4c80-8819-1328df6581fa. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:57:45 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90" returned: 0 in 0.458s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90 Aug 05 15:57:45 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7cc1c-cd63-41f4-b62b-7254e0ad4e3a]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 Aug 05 15:57:45 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" returned: 0 in 0.301s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6 Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-6b9f9dd1-0ef0-450b-98a7-215fb391b36e" released by "delete_volume" :: held 0.800s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:45 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c313d9dc-0141-42b6-b5c7-637a34447b90" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-c313d9dc-0141-42b6-b5c7-637a34447b90" released by "delete_volume" :: held 0.810s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:45 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['9307456f-ad58-4118-ba0d-5859bcd5b972', 'cc91eecd-3a0e-4221-82c5-139bfea71b3c', 'e5768e0e-b861-4882-82a1-abb51a401d45', '86df8183-b403-4551-9f87-e2e5d46c6042'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14" returned: 0 in 0.417s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:45 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14 Aug 05 15:57:45 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Created reservations ['ffd756d6-d0d6-4245-8606-0d5d04a45b22', 'fccd8214-45a6-405f-a95c-108541215f80', 'a49dcd8b-e3d6-4311-808a-302a7964f0dd', 'd6b5bb8b-5d6d-4734-8abf-c04e89aa61eb'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6" returned: 0 in 0.520s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:46 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-aa19524b-7c45-41b9-a2df-286ffd2c8f32-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-aa19524b-7c45-41b9-a2df-286ffd2c8f32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:46 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-aa19524b-7c45-41b9-a2df-286ffd2c8f32" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-aa19524b-7c45-41b9-a2df-286ffd2c8f32" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:46 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-75426f36-e7c2-4314-8d78-339b88c52b14" returned: 0 in 0.403s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "cinder-quobyte-75426f36-e7c2-4314-8d78-339b88c52b14" released by "delete_volume" :: held 0.867s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a27d4a-4c82-4675-85b0-8678221e19f3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6 Aug 05 15:57:46 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Created reservations ['12ac823d-0ef2-496e-9563-f3a311a7b51e', 'dd70cd03-0f5a-465c-bb1b-e4b58889faa2', '8e8aee62-3d5a-4fcc-b81e-d71e1a8434f5', 'adb6b5ed-bbed-4bdd-9d7d-68911038726d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:46 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.338s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:46 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 Aug 05 15:57:46 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d2d985fa-3baa-44f3-a768-acbe45180ab1 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-6b9f9dd1-0ef0-450b-98a7-215fb391b36e-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:46 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.387s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Deleted volume successfully. Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0a27f314-e844-42e4-a1d0-bdc95bb7dfde tempest-VolumesActionsTest-929851242 None] Lock "cinder-c313d9dc-0141-42b6-b5c7-637a34447b90-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:46 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6" returned: 1 in 0.549s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_gsw0ctu6' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d12eb0-b247-47e5-80ca-54028fdece30]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32" returned: 0 in 0.504s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:46 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD Aug 05 15:57:46 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32 Aug 05 15:57:46 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:46 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.350s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Deleted volume successfully. Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0cdcb133-9343-42c3-ab24-c74b39961917 tempest-VolumesCloneNegativeTest-316284092 None] Lock "cinder-75426f36-e7c2-4314-8d78-339b88c52b14-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:46 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:46 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:47 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aa19524b-7c45-41b9-a2df-286ffd2c8f32" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:47 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:47 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-aa19524b-7c45-41b9-a2df-286ffd2c8f32" released by "delete_volume" :: held 0.858s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['369a797d-07ff-49bc-b648-169dc2c1fec3', '31e72f72-e40f-47d4-af9b-83cc61640679', 'f447c18d-88ae-4622-a4c2-c235b385c02c', 'eef9cdfe-248b-4211-8927-e14bebc00ea5'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:47 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:47 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-a46e7ae0-66da-481d-88f9-95e2b0643036-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-a46e7ae0-66da-481d-88f9-95e2b0643036-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-a46e7ae0-66da-481d-88f9-95e2b0643036" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-a46e7ae0-66da-481d-88f9-95e2b0643036" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd2feb-6c0d-418f-9d51-3f75f4fcd31f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:47 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 Aug 05 15:57:47 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:47 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.598s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2b122cc6-994c-4c4d-a126-01496bbab89a tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-aa19524b-7c45-41b9-a2df-286ffd2c8f32-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (73ae8968-e8ef-4209-b3e1-9395701adc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b4eb6b-5cdb-4b02-8ef2-66f8a9abcbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:48 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036" returned: 0 in 0.706s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b4eb6b-5cdb-4b02-8ef2-66f8a9abcbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1925610172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14324500-ec1f-4b04-886b-2e1e76fd09d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:48Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:48 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036 Aug 05 15:57:48 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bda953-1d88-4b8c-ae19-df7ab1733e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bda953-1d88-4b8c-ae19-df7ab1733e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5420019-0679-4e87-a754-b338dd1b4783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5420019-0679-4e87-a754-b338dd1b4783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14324500-ec1f-4b04-886b-2e1e76fd09d2', 'volume_name': 'volume-14324500-ec1f-4b04-886b-2e1e76fd09d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183a54b8-fc29-4a62-93fa-436a242abbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183a54b8-fc29-4a62-93fa-436a242abbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf1e64-c32c-40f3-a254-5006d3777d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Volume 14324500-ec1f-4b04-886b-2e1e76fd09d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14324500-ec1f-4b04-886b-2e1e76fd09d2', 'volume_size': 1} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1925610172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14324500-ec1f-4b04-886b-2e1e76fd09d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:48Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Creating volume 14324500-ec1f-4b04-886b-2e1e76fd09d2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:48 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:48 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 1073741824 Aug 05 15:57:48 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:48 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a46e7ae0-66da-481d-88f9-95e2b0643036" returned: 0 in 0.326s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-a46e7ae0-66da-481d-88f9-95e2b0643036" released by "delete_volume" :: held 1.099s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['3e63a5c5-ea8f-4a23-8bbd-ddaa8bc8bf73', '11a623a4-9250-416c-bcee-11df3be36e59', '0708cf2d-a612-428e-a118-599f5f9ebd64', '380f32af-eece-4396-abdc-8a841e4b46bb'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:48 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:48 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:48 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 1073741824" returned: 0 in 0.629s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:49 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 Aug 05 15:57:49 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:49 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.339s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0bb58825-631d-4401-a2af-2399b51025a9 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-a46e7ae0-66da-481d-88f9-95e2b0643036-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:49 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 2.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_h7qkifyhdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:57:49 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Converted 112.00 MB image at 49.52 MB/s Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:49 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1G Aug 05 15:57:49 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:49 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2" returned: 0 in 0.321s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf1e64-c32c-40f3-a254-5006d3777d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14324500-ec1f-4b04-886b-2e1e76fd09d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756ae881-dd2e-4b77-9b2f-dde36cb6819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:49 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Volume volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 (14324500-ec1f-4b04-886b-2e1e76fd09d2): created successfully Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756ae881-dd2e-4b77-9b2f-dde36cb6819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (73ae8968-e8ef-4209-b3e1-9395701adc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f7d39a26-bbfb-42b7-bf3d-24c0d88d413e tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:57:49 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 1G" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb7254-1bce-4748-a10b-f2512634e2fe]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-c827f240-ba24-49f5-a1fe-0482a4632feb-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:49 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:49 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-c827f240-ba24-49f5-a1fe-0482a4632feb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-c827f240-ba24-49f5-a1fe-0482a4632feb" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-c827f240-ba24-49f5-a1fe-0482a4632feb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleting offline snapshot c827f240-ba24-49f5-a1fe-0482a4632feb of volume 794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] snapshot_file for this snap is: volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc1e04-03b6-4dd0-8192-71eac11d6e6e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:49 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb Aug 05 15:57:49 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:50 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 0.459s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:50 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:50 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:50 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb" returned: 0 in 0.481s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-794e2989-a511-4bd8-9ab9-290795d13515(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dad3ed1-649e-48ea-a4ef-b8e5389698b4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:50 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 1 in 0.419s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Downloaded image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume bc15a794-b24a-4c80-8819-1328df6581fa successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad for user 74e429c7c028439e82d39b4068453264 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Marking volume bc15a794-b24a-4c80-8819-1328df6581fa as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Copying metadata from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad to bc15a794-b24a-4c80-8819-1328df6581fa. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Creating volume glance metadata for volume bc15a794-b24a-4c80-8819-1328df6581fa backed by image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-14324500-ec1f-4b04-886b-2e1e76fd09d2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:50 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 Aug 05 15:57:50 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "cinder-14324500-ec1f-4b04-886b-2e1e76fd09d2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-quobyte-14324500-ec1f-4b04-886b-2e1e76fd09d2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69f245-ae47-4cf2-b288-d3261105e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc15a794-b24a-4c80-8819-1328df6581fa', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6c4f35-8dc6-4954-b566-74cb0a246f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-14324500-ec1f-4b04-886b-2e1e76fd09d2" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Volume volume-bc15a794-b24a-4c80-8819-1328df6581fa (bc15a794-b24a-4c80-8819-1328df6581fa): created successfully Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6c4f35-8dc6-4954-b566-74cb0a246f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Flow 'volume_create_manager' (16a9285e-4f49-4f5d-bc10-53b830e81a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[286be3b9-afcb-4237-b1a3-fc30f2e8ba62]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d8fd4b26-098e-4355-b9f4-ea78e63c996b tempest-VolumesExtendTest-1015518223 None] Created volume successfully. Aug 05 15:57:50 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:50 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 Aug 05 15:57:50 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:50 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb Aug 05 15:57:50 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:51 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2" returned: 0 in 0.515s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:51 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2 Aug 05 15:57:51 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:51 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb" returned: 0 in 0.495s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd551e23-000e-48e1-95de-96d0ac2e6d98]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:51 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb Aug 05 15:57:51 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:51 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:51 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:51 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-14324500-ec1f-4b04-886b-2e1e76fd09d2" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-14324500-ec1f-4b04-886b-2e1e76fd09d2" released by "delete_volume" :: held 0.879s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Created reservations ['bd8a8923-557d-4d6b-924d-4362e2f2eac2', 'f4ab4ab5-dfd8-4256-a1cb-c79489804658', 'c3ca545f-e3ab-4d0b-a68f-cbc6c0908b73', '08752bfb-c1c4-419b-b75a-18eb8a8cd25f'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:51 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515.c827f240-ba24-49f5-a1fe-0482a4632feb" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-c827f240-ba24-49f5-a1fe-0482a4632feb" released by "_delete_snapshot" :: held 1.920s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" released by "delete_snapshot" :: held 1.952s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:51 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:51 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:51 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['a936e07f-72e5-4ba9-8475-dc362ed7dcf4', '7e6faa4f-6065-4807-8d85-fe188c1b93f4', '364edc6c-6da3-4093-a625-b0354a5bfd07', '804a3332-64d2-4a84-978c-75f693b7dcf6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 0.499s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Delete snapshot completed successfully. Aug 05 15:57:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ae92e6e5-d6b4-4add-93fe-e1b6fc5ae5da tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-c827f240-ba24-49f5-a1fe-0482a4632feb-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:52 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:52 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:52 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.368s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Deleted volume successfully. Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-29b55a06-625b-4830-85c3-a278b73e5d98 tempest-VolumesActionsTest-929851242 None] Lock "cinder-14324500-ec1f-4b04-886b-2e1e76fd09d2-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:52 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 1 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 2G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (10b4076a-331f-4b3c-bafd-14b46d226d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9d6715-55bd-40d7-ad00-9a05fc0f03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa 2G" returned: 0 in 0.110s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.148s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9d6715-55bd-40d7-ad00-9a05fc0f03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054241508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93ab699-a012-41d1-8460-1dbd941a5d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:52Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c22aaf-cd1e-4c4d-af24-ab7b886e8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c22aaf-cd1e-4c4d-af24-ab7b886e8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9c62ac-be13-4ac9-bbd0-826a0fc14240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9c62ac-be13-4ac9-bbd0-826a0fc14240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93ab699-a012-41d1-8460-1dbd941a5d36', 'volume_name': 'volume-e93ab699-a012-41d1-8460-1dbd941a5d36', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cfdabc-9aa7-457d-aab4-b6e9df64dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cfdabc-9aa7-457d-aab4-b6e9df64dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229e998e-fb7e-416b-b456-b3804a0bba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Volume e93ab699-a012-41d1-8460-1dbd941a5d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93ab699-a012-41d1-8460-1dbd941a5d36', 'volume_size': 1} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054241508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93ab699-a012-41d1-8460-1dbd941a5d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:52Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Creating volume e93ab699-a012-41d1-8460-1dbd941a5d36 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:52 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:52 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 1073741824 Aug 05 15:57:52 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-58605d61-59e9-4d73-907d-240cb20c513c tempest-VolumesExtendTest-1015518223 None] Extend volume completed successfully. Aug 05 15:57:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-794e2989-a511-4bd8-9ab9-290795d13515-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-794e2989-a511-4bd8-9ab9-290795d13515-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:53 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 1073741824" returned: 0 in 0.496s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[78552532-d16c-4c75-8e7e-3255696411f2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:53 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 Aug 05 15:57:53 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:53 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 Aug 05 15:57:53 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:53 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229e998e-fb7e-416b-b456-b3804a0bba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93ab699-a012-41d1-8460-1dbd941a5d36', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d6cd93-ec9e-44d7-be7e-1bf7ad6c3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Volume volume-e93ab699-a012-41d1-8460-1dbd941a5d36 (e93ab699-a012-41d1-8460-1dbd941a5d36): created successfully Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d6cd93-ec9e-44d7-be7e-1bf7ad6c3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (10b4076a-331f-4b3c-bafd-14b46d226d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-67b129e4-7092-4a2e-a239-46331e6a652b tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:57:53 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515" returned: 0 in 0.480s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:53 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515 Aug 05 15:57:53 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-bc15a794-b24a-4c80-8819-1328df6581fa-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-bc15a794-b24a-4c80-8819-1328df6581fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-quobyte-bc15a794-b24a-4c80-8819-1328df6581fa" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-bc15a794-b24a-4c80-8819-1328df6581fa" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:53 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-794e2989-a511-4bd8-9ab9-290795d13515" returned: 0 in 0.310s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-quobyte-794e2989-a511-4bd8-9ab9-290795d13515" released by "delete_volume" :: held 0.865s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfd51f-e049-4bd9-94db-3744bb3653ab]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Created reservations ['25ea859b-5395-4ae2-a31f-b07ea8494cba', 'fb93a798-3ea7-4e09-ae19-29d59b6dc400', '4afdaa06-001a-4a8c-bd69-c890dabdbaff', 'b2c53a65-2424-4a10-b715-ca12c55c41c1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:54 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:54 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:54 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:54 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:54 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 0.486s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:54 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Deleted volume successfully. Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a2f00d3-d982-4574-8622-20a541f29920 tempest-CreateVolumesFromSnapshotTest-1340778569 None] Lock "cinder-794e2989-a511-4bd8-9ab9-290795d13515-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:54 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:54 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-e93ab699-a012-41d1-8460-1dbd941a5d36-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "cinder-e93ab699-a012-41d1-8460-1dbd941a5d36-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-quobyte-e93ab699-a012-41d1-8460-1dbd941a5d36" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-e93ab699-a012-41d1-8460-1dbd941a5d36" acquired by "delete_volume" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5368cdd-d369-4e3c-bb09-bf270f7ad18d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:54 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 Aug 05 15:57:54 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:55 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 1 in 0.574s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:55 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa Aug 05 15:57:55 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:55 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc15a794-b24a-4c80-8819-1328df6581fa" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:55 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-bc15a794-b24a-4c80-8819-1328df6581fa" released by "delete_volume" :: held 1.559s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36" returned: 0 in 0.665s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:55 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36 Aug 05 15:57:55 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Created reservations ['a4ba9732-cff6-477e-8f2a-d651762c5cdb', 'ff9a0e5a-1738-43be-93a8-389820080c38', 'a59a5d4d-4f28-4d5c-8f4f-07e153e4a9d6', 'd7b85198-ed86-4749-880f-3da8070ce7b8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:55 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:55 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:55 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e93ab699-a012-41d1-8460-1dbd941a5d36" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-e93ab699-a012-41d1-8460-1dbd941a5d36" released by "delete_volume" :: held 1.068s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Created reservations ['753ce942-f552-43ed-a92f-8d3ec98c3ad9', '91c6af20-3216-4da3-81eb-26500dcf7970', '1e06dd95-fa88-464e-88b5-e5fcc7b41d10', 'ef7af8b3-232e-4b13-b3c6-5e10da682357'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:57:55 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:55 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Deleted volume successfully. Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-42c7c5b2-36af-4fdf-902d-df50ef5f75b0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-bc15a794-b24a-4c80-8819-1328df6581fa-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:56 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:57:56 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:56 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:57:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Deleted volume successfully. Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e6a364e6-bb7e-4ae4-ba75-1ef22b49bec5 tempest-VolumesActionsTest-929851242 None] Lock "cinder-e93ab699-a012-41d1-8460-1dbd941a5d36-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Flow 'volume_create_manager' (36f6bba2-33fe-4eb8-9249-1ec37b7d7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4a6732-f757-4c5d-b70f-43bd3ce9fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4a6732-f757-4c5d-b70f-43bd3ce9fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042982222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4f3b439474d3a95c5da621282ae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:57Z,use_quota=True,user_id='74e429c7c028439e82d39b4068453264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5096675-36b8-474d-8cad-bf02cd2d192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5096675-36b8-474d-8cad-bf02cd2d192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2f15c3-28bc-4887-95e6-d8e2780d80c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2f15c3-28bc-4887-95e6-d8e2780d80c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a', 'volume_name': 'volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a66886-f800-4299-98de-7686b4f009a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a66886-f800-4299-98de-7686b4f009a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c11f12b-e310-48cf-9fd2-04f749bd10e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Volume fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a', 'volume_size': 1} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042982222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4f3b439474d3a95c5da621282ae9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:57Z,use_quota=True,user_id='74e429c7c028439e82d39b4068453264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Creating volume fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:56 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a 1073741824 Aug 05 15:57:56 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:57 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a 1073741824" returned: 0 in 0.526s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:57 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:57:57 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (dd2f6af9-1ad2-4546-b522-76917657e38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320c4902-64de-4e00-85e8-7671662a2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320c4902-64de-4e00-85e8-7671662a2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-136815326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b14d539-5b12-453c-84ab-a622eacf6601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:58Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ce9d81-d3e8-4ef4-88bc-d5e7e282341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ce9d81-d3e8-4ef4-88bc-d5e7e282341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c4a25-f64a-48fb-ba56-d7935362fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c4a25-f64a-48fb-ba56-d7935362fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b14d539-5b12-453c-84ab-a622eacf6601', 'volume_name': 'volume-7b14d539-5b12-453c-84ab-a622eacf6601', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d27124-1055-40a3-a4da-305909623a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d27124-1055-40a3-a4da-305909623a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88122679-8a54-4ec2-aa40-0bb334c1ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Volume 7b14d539-5b12-453c-84ab-a622eacf6601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b14d539-5b12-453c-84ab-a622eacf6601', 'volume_size': 1} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-136815326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b14d539-5b12-453c-84ab-a622eacf6601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:57:58Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Creating volume 7b14d539-5b12-453c-84ab-a622eacf6601 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:57:57 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c11f12b-e310-48cf-9fd2-04f749bd10e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331c85e-7122-45b6-a523-eec249821c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:57 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 1073741824 Aug 05 15:57:57 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Volume volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a (fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a): created successfully Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331c85e-7122-45b6-a523-eec249821c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Flow 'volume_create_manager' (36f6bba2-33fe-4eb8-9249-1ec37b7d7a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4a629196-ff33-4752-99ad-0a6d96d6cbc2 tempest-VolumesExtendTest-1015518223 None] Created volume successfully. Aug 05 15:57:58 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 1073741824" returned: 0 in 0.591s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:58 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 Aug 05 15:57:58 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:58 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88122679-8a54-4ec2-aa40-0bb334c1ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b14d539-5b12-453c-84ab-a622eacf6601', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f59813-7ac3-4584-9a5d-ba02d29744b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:57:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Volume volume-7b14d539-5b12-453c-84ab-a622eacf6601 (7b14d539-5b12-453c-84ab-a622eacf6601): created successfully Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f59813-7ac3-4584-9a5d-ba02d29744b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:57:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (dd2f6af9-1ad2-4546-b522-76917657e38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:57:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b665d85e-60c7-43ae-a7c6-f6274e51fa47 tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Creating offline snapshot 9de93216-5bdb-4d3d-9029-26091ca62375 of volume fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[037dcb3b-e356-47ee-9986-88e946a3135d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:59 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:57:59 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:57:59 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.393s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:57:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:57:59 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 1G Aug 05 15:57:59 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:00 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 1G" returned: 0 in 0.554s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-7b14d539-5b12-453c-84ab-a622eacf6601-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "cinder-7b14d539-5b12-453c-84ab-a622eacf6601-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:00 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 Aug 05 15:58:00 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Acquiring lock "cinder-quobyte-7b14d539-5b12-453c-84ab-a622eacf6601" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-7b14d539-5b12-453c-84ab-a622eacf6601" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a926b3-878f-465f-8ee2-86f6e898f690]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:00 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 Aug 05 15:58:00 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:00 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375" returned: 0 in 0.486s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:00 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 is being set with open permissions: ugo+rw Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:00 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 Aug 05 15:58:00 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:00 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601" returned: 0 in 0.519s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:00 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601 Aug 05 15:58:00 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:00 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375" returned: 0 in 0.317s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:00 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info Aug 05 15:58:00 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:01 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7b14d539-5b12-453c-84ab-a622eacf6601" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "cinder-quobyte-7b14d539-5b12-453c-84ab-a622eacf6601" released by "delete_volume" :: held 0.948s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Created reservations ['2afd8c8c-4507-4656-9360-8ee4bfec034a', '82b20414-f435-4c7f-9e0b-54476ce8ccb1', '072ef25b-65d4-4ade-98b6-0159201fa6cd', '5c09d0df-e578-4eed-9edc-952c404e3e69'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:01 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info" returned: 0 in 0.420s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:01 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info is being set with open permissions: ugo+rw Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:01 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info Aug 05 15:58:01 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:01 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:01 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Flow 'volume_create_manager' (a0693b4c-e484-42e9-9464-6b8833daacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73afd4b2-300f-4992-b5d9-65e8caa143b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73afd4b2-300f-4992-b5d9-65e8caa143b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41578871-3c73-40ca-bbc8-add1a07cf032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131d77b886814975a67b70474edfd213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:01Z,use_quota=True,user_id='065f157ba1a5467594dc443dc32b31e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfed7f6-0a77-41de-a573-069efd87defa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfed7f6-0a77-41de-a573-069efd87defa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15985319-188d-4265-b486-428f187d02d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:58:01 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.info" returned: 0 in 0.326s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ed3b5075-7519-49e3-be77-3e73c10d113a tempest-VolumesExtendTest-1015518223 None] Create snapshot completed successfully Aug 05 15:58:01 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.363s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Deleted volume successfully. Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9087e11a-ccd4-48a2-ab92-2a5d58f0c839 tempest-VolumesActionsTest-929851242 None] Lock "cinder-7b14d539-5b12-453c-84ab-a622eacf6601-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15985319-188d-4265-b486-428f187d02d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41578871-3c73-40ca-bbc8-add1a07cf032', 'volume_name': 'volume-41578871-3c73-40ca-bbc8-add1a07cf032', 'volume_size': 1, 'image_id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fae384b7226528a5869a6db9b3c6bb29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '131d77b886814975a67b70474edfd213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbfcdd7ce5da20b03e540c2ac43c5de19ca91195f01aa6704027270f31790f4219542b0373a0c1541cedf7e949402d021e72b344364c2cca76df05028fb41bf5', 'id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'created_at': datetime.datetime(2026, 8, 5, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb21440-7b99-4887-a87c-5051b900d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb21440-7b99-4887-a87c-5051b900d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2839a791-461f-419f-8744-a0a2e0c9c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Volume 41578871-3c73-40ca-bbc8-add1a07cf032: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41578871-3c73-40ca-bbc8-add1a07cf032', 'volume_size': 1, 'image_id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fae384b7226528a5869a6db9b3c6bb29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '131d77b886814975a67b70474edfd213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbfcdd7ce5da20b03e540c2ac43c5de19ca91195f01aa6704027270f31790f4219542b0373a0c1541cedf7e949402d021e72b344364c2cca76df05028fb41bf5', 'id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'created_at': datetime.datetime(2026, 8, 5, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5/file', 'properties': {}}, 'image_service': } Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Trying to clone 41578871-3c73-40ca-bbc8-add1a07cf032 from image d1c530a7-aad8-4bb9-89eb-da7652081ad5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:58:01 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:58:01 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cda399-d1d4-484e-ade9-d23a7126eff7]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:02 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:02 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2546c7f-6ecb-4b77-852d-28e3df2f564e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:02 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:02 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:58:02 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:02 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:02 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:02 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:02 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Temporary image d1c530a7-aad8-4bb9-89eb-da7652081ad5 is fetched for user 065f157ba1a5467594dc443dc32b31e6. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:58:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.541s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 2G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d075bb6-7d49-445d-8559-cd69ef9816c4]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (e02c2136-01fc-41ce-8119-e444a28cba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41782b-d695-4394-94e7-443f33738d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f41782b-d695-4394-94e7-443f33738d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488199213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d1864-adc5-49f1-b362-0290cddd3a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:03Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:03 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:03 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63137ae3-0263-49fb-a2e7-8f9efde80e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63137ae3-0263-49fb-a2e7-8f9efde80e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7583c2e3-0a9f-485b-9a42-3d8df0fb675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7583c2e3-0a9f-485b-9a42-3d8df0fb675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045d1864-adc5-49f1-b362-0290cddd3a50', 'volume_name': 'volume-045d1864-adc5-49f1-b362-0290cddd3a50', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6c5038-1ce5-4f29-85f3-16a52b79026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6c5038-1ce5-4f29-85f3-16a52b79026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e47bd9-b123-4089-b7cd-9224f407aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:03 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Volume 045d1864-adc5-49f1-b362-0290cddd3a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045d1864-adc5-49f1-b362-0290cddd3a50', 'volume_size': 1} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 2G" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.853s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488199213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d1864-adc5-49f1-b362-0290cddd3a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee5d5802034c66adbb5bbc521c6787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:03Z,use_quota=True,user_id='7be678418fe2460b8d900c6fe59a5b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Creating volume 045d1864-adc5-49f1-b362-0290cddd3a50 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:03 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 1073741824 Aug 05 15:58:03 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2709ef64-8975-4e2f-b26f-7512a679250e tempest-VolumesExtendTest-1015518223 None] Extend volume completed successfully. Aug 05 15:58:03 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:03 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-9de93216-5bdb-4d3d-9029-26091ca62375-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:03 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:03 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-9de93216-5bdb-4d3d-9029-26091ca62375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-quobyte-9de93216-5bdb-4d3d-9029-26091ca62375" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-9de93216-5bdb-4d3d-9029-26091ca62375" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Deleting offline snapshot 9de93216-5bdb-4d3d-9029-26091ca62375 of volume fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] snapshot_file for this snap is: volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6393f943-8aef-4be1-ad29-f63f0ac9acbb]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:03 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:03 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 1073741824" returned: 0 in 0.652s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:04 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 Aug 05 15:58:04 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:04 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 Aug 05 15:58:04 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:04 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.397s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:58:04 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50" returned: 0 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41578871-3c73-40ca-bbc8-add1a07cf032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='131d77b886814975a67b70474edfd213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:01Z,use_quota=True,user_id='065f157ba1a5467594dc443dc32b31e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Creating volume 41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:04 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e47bd9-b123-4089-b7cd-9224f407aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045d1864-adc5-49f1-b362-0290cddd3a50', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:04 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1073741824 Aug 05 15:58:04 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2e75b-255b-4f90-935c-cc822def9f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Volume volume-045d1864-adc5-49f1-b362-0290cddd3a50 (045d1864-adc5-49f1-b362-0290cddd3a50): created successfully Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2e75b-255b-4f90-935c-cc822def9f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Flow 'volume_create_manager' (e02c2136-01fc-41ce-8119-e444a28cba2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:04 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-8470701d-a38b-4272-a62d-ba15d243d82d tempest-VolumesActionsTest-755011188 None] Created volume successfully. Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f2803-7f74-4c61-bb20-352da366f0d7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:04 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:58:04 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:04 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1073741824" returned: 0 in 0.528s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:04 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.421s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:04 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 Aug 05 15:58:04 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:04 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:04 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:05 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Attempting download of d1c530a7-aad8-4bb9-89eb-da7652081ad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}])) to volume 41578871-3c73-40ca-bbc8-add1a07cf032. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7708cbe-3111-44d5-8afa-f2d860d84732]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:05 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375" returned: 0 in 0.505s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:05 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k Aug 05 15:58:05 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:05 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375 Aug 05 15:58:05 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:05 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k" returned: 0 in 0.362s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:05 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a.9de93216-5bdb-4d3d-9029-26091ca62375" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=147,cinder:UPDATE=202,cinder:DELETE=18,cinder:INSERT=52 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=153,cinder:INSERT=52,cinder:UPDATE=199,cinder:DELETE=17 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-9de93216-5bdb-4d3d-9029-26091ca62375" released by "_delete_snapshot" :: held 1.960s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" released by "delete_snapshot" :: held 2.002s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:05 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k Aug 05 15:58:05 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Created reservations ['e6e593a5-f43a-4db3-a85a-029844081289', '9c1acde0-e479-4d3f-b5d6-c881df9970e2', 'b3219428-9304-4248-9dc9-4e06bd1be239', '7f83c77c-afcc-4b5f-9598-ce881b96893c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Delete snapshot completed successfully. Aug 05 15:58:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-623bf3a0-ff77-4df5-8271-1a5313cf4596 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-9de93216-5bdb-4d3d-9029-26091ca62375-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:06 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-045d1864-adc5-49f1-b362-0290cddd3a50-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k" returned: 1 in 0.421s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1c530a7-aad8-4bb9-89eb-da7652081ad5_yxtolw8k' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9512de-50be-4d74-b0ea-81666b5c39b6]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "cinder-045d1864-adc5-49f1-b362-0290cddd3a50-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Acquiring lock "cinder-quobyte-045d1864-adc5-49f1-b362-0290cddd3a50" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "cinder-quobyte-045d1864-adc5-49f1-b362-0290cddd3a50" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118b2f1-6094-4d97-a4ed-3a5104604f99]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:06 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:06 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:06 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 Aug 05 15:58:06 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:06 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:06 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:06 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD Aug 05 15:58:06 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:06 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50 Aug 05 15:58:06 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:06 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] d1c530a7-aad8-4bb9-89eb-da7652081ad5 was raw, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:06 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-045d1864-adc5-49f1-b362-0290cddd3a50" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:06 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:06 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "cinder-quobyte-045d1864-adc5-49f1-b362-0290cddd3a50" released by "delete_volume" :: held 0.724s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Created reservations ['ff6270d9-e228-475e-91fd-f2a068285377', '18d6816b-5e05-4b46-9a4c-7c966e42b66a', '136bb1f0-b1df-400d-bb24-d7811f75bf6d', '22f364ba-8b7f-4c5b-b741-75dd0bab3878'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:07 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:07 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7242c5-f276-498c-ad9d-4f81979cc9fa]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:07 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:58:07 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:07 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:07 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 0 in 0.565s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1c530a7-aad8-4bb9-89eb-da7652081ad5_u57eulv3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:58:07 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.334s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Deleted volume successfully. Aug 05 15:58:07 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1G Aug 05 15:58:07 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e98b0471-2b8b-49ae-959d-63b069b7968a tempest-VolumesActionsTest-755011188 None] Lock "cinder-045d1864-adc5-49f1-b362-0290cddd3a50-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:07 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.506s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:07 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a Aug 05 15:58:07 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:07 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 1G" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[52556c1f-8c2a-4727-b9ab-30e667c3e6a7]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:08 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:08 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:08 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" returned: 0 in 0.305s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-quobyte-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a" released by "delete_volume" :: held 0.900s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Created reservations ['bb4908c5-ef64-4735-8828-638ebaf5b8ae', '8d815da9-258c-44e3-b9fc-17ee8c822e78', 'af2bb36b-3b40-46b9-b996-c9b645a10ff6', 'a0bdc77b-83d2-434a-b3b4-45c8906368d6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:08 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:08 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:08 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 0 in 0.520s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:08 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:08 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:08 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Deleted volume successfully. Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3214ad90-5b82-41e6-8dd0-c43d9f29cfe0 tempest-VolumesExtendTest-1015518223 None] Lock "cinder-fa0c49c3-b428-4944-9f2c-0dde9c3e6e4a-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:08 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 1 in 0.516s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Downloaded image d1c530a7-aad8-4bb9-89eb-da7652081ad5 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}])) to volume 41578871-3c73-40ca-bbc8-add1a07cf032 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Temporary image d1c530a7-aad8-4bb9-89eb-da7652081ad5 for user 065f157ba1a5467594dc443dc32b31e6 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Marking volume 41578871-3c73-40ca-bbc8-add1a07cf032 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Copying metadata from image d1c530a7-aad8-4bb9-89eb-da7652081ad5 to 41578871-3c73-40ca-bbc8-add1a07cf032. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:58:08 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Creating volume glance metadata for volume 41578871-3c73-40ca-bbc8-add1a07cf032 backed by image d1c530a7-aad8-4bb9-89eb-da7652081ad5 with: {'image_id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fae384b7226528a5869a6db9b3c6bb29', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:58:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2839a791-461f-419f-8744-a0a2e0c9c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41578871-3c73-40ca-bbc8-add1a07cf032', 'volume_size': 1, 'image_id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fae384b7226528a5869a6db9b3c6bb29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '131d77b886814975a67b70474edfd213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbfcdd7ce5da20b03e540c2ac43c5de19ca91195f01aa6704027270f31790f4219542b0373a0c1541cedf7e949402d021e72b344364c2cca76df05028fb41bf5', 'id': 'd1c530a7-aad8-4bb9-89eb-da7652081ad5', 'created_at': datetime.datetime(2026, 8, 5, 13, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1c530a7-aad8-4bb9-89eb-da7652081ad5/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aab3311-86ed-4d7e-8dc5-17a686c9f376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:09 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Volume volume-41578871-3c73-40ca-bbc8-add1a07cf032 (41578871-3c73-40ca-bbc8-add1a07cf032): created successfully Aug 05 15:58:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aab3311-86ed-4d7e-8dc5-17a686c9f376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Flow 'volume_create_manager' (a0693b4c-e484-42e9-9464-6b8833daacf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f6f0951d-a527-45d8-a3f4-b7328c17b599 tempest-VolumeImageDependencyTests-950696343 None] Created volume successfully. Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Acquiring lock "cinder-41578871-3c73-40ca-bbc8-add1a07cf032-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "cinder-41578871-3c73-40ca-bbc8-add1a07cf032-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Acquiring lock "cinder-quobyte-41578871-3c73-40ca-bbc8-add1a07cf032" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "cinder-quobyte-41578871-3c73-40ca-bbc8-add1a07cf032" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5cd656-9af4-4f41-863d-179642d49a46]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:10 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:10 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:10 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 0 in 0.443s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:10 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:10 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:11 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 1 in 0.488s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:11 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032 Aug 05 15:58:11 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:11 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-41578871-3c73-40ca-bbc8-add1a07cf032" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "cinder-quobyte-41578871-3c73-40ca-bbc8-add1a07cf032" released by "delete_volume" :: held 1.344s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Created reservations ['87c03b14-0c5d-467b-8c46-993675a88caf', 'dedcfbea-24ce-4adb-8b91-f950b87fd7eb', 'd56dfae9-b4c5-407c-b315-4339df881e3a', '9ce0d04a-5ea6-4db4-b149-88b0de7443a9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:11 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:11 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:12 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Deleted volume successfully. Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b60e31d-2481-4ef1-a529-d65c9d5b82f7 tempest-VolumeImageDependencyTests-950696343 None] Lock "cinder-41578871-3c73-40ca-bbc8-add1a07cf032-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Flow 'volume_create_manager' (dca4008f-a099-4898-913f-0054384e2a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cf0351-fae7-4cbe-9ea2-91fb7e55e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cf0351-fae7-4cbe-9ea2-91fb7e55e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1133850741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cd3882-6f15-41af-b52f-10213751def3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29780b1635a9437ab80317c1c39ee264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:13Z,use_quota=True,user_id='ad4e46185e7749b1a8481d66a8e557e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17348849-2cee-4375-a82f-c21989e9ff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17348849-2cee-4375-a82f-c21989e9ff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5df87-7c80-4009-9cdb-8bb477a84542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5df87-7c80-4009-9cdb-8bb477a84542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cd3882-6f15-41af-b52f-10213751def3', 'volume_name': 'volume-67cd3882-6f15-41af-b52f-10213751def3', 'volume_size': 2}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70afcf28-c005-43f0-81c8-3bc811138ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70afcf28-c005-43f0-81c8-3bc811138ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a3306-4040-4916-85bd-8c4d7f40db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Volume 67cd3882-6f15-41af-b52f-10213751def3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cd3882-6f15-41af-b52f-10213751def3', 'volume_size': 2} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1133850741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cd3882-6f15-41af-b52f-10213751def3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29780b1635a9437ab80317c1c39ee264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:13Z,use_quota=True,user_id='ad4e46185e7749b1a8481d66a8e557e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Creating volume 67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:12 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 2147483648 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:13 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 2147483648 Aug 05 15:58:13 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:13 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 2147483648" returned: 0 in 0.728s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:13 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 Aug 05 15:58:13 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:14 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3" returned: 0 in 0.273s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a3306-4040-4916-85bd-8c4d7f40db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cd3882-6f15-41af-b52f-10213751def3', 'volume_size': 2}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688ae9c9-09d1-4477-90e3-dfef8ecfcb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Volume volume-67cd3882-6f15-41af-b52f-10213751def3 (67cd3882-6f15-41af-b52f-10213751def3): created successfully Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688ae9c9-09d1-4477-90e3-dfef8ecfcb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Flow 'volume_create_manager' (dca4008f-a099-4898-913f-0054384e2a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fc6079e8-4f7c-4abb-b8a7-c7b7d33f5379 tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Created volume successfully. Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Creating offline snapshot 17b798e8-440a-4f3d-b3c2-195664cf7a79 of volume 67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[06898425-622e-4456-980d-d0b12da688e1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:15 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 Aug 05 15:58:15 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:15 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3" returned: 0 in 0.439s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 2G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:15 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 2G Aug 05 15:58:15 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:16 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 2G" returned: 0 in 0.530s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67cd3882-6f15-41af-b52f-10213751def3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:16 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67cd3882-6f15-41af-b52f-10213751def3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 Aug 05 15:58:16 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:16 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67cd3882-6f15-41af-b52f-10213751def3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:16 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 is being set with open permissions: ugo+rw Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:16 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 Aug 05 15:58:16 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:16 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:16 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info Aug 05 15:58:16 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:17 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info" returned: 0 in 0.255s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:17 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info is being set with open permissions: ugo+rw Aug 05 15:58:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:17 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info Aug 05 15:58:17 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:17 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.info" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d04bb770-f96b-4e8e-ba1a-daab1da4fceb tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Create snapshot completed successfully Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "cinder-17b798e8-440a-4f3d-b3c2-195664cf7a79-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-17b798e8-440a-4f3d-b3c2-195664cf7a79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "cinder-quobyte-17b798e8-440a-4f3d-b3c2-195664cf7a79" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-17b798e8-440a-4f3d-b3c2-195664cf7a79" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Deleting offline snapshot 17b798e8-440a-4f3d-b3c2-195664cf7a79 of volume 67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] snapshot_file for this snap is: volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1565f69c-7e6a-47e0-9fdc-f54602969543]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:18 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 Aug 05 15:58:18 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:19 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79" returned: 0 in 0.564s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67cd3882-6f15-41af-b52f-10213751def3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab598d65-74cd-4d94-8e74-a1d223eba0b6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:19 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 Aug 05 15:58:19 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:19 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3" returned: 0 in 0.472s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:19 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 Aug 05 15:58:19 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:20 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79" returned: 0 in 0.512s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:20 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79 Aug 05 15:58:20 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:20 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3.17b798e8-440a-4f3d-b3c2-195664cf7a79" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-17b798e8-440a-4f3d-b3c2-195664cf7a79" released by "_delete_snapshot" :: held 2.095s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" released by "delete_snapshot" :: held 2.130s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Created reservations ['f1fc7190-f0ca-4462-8449-645d958439b0', 'ac698a88-96ae-40ae-af3d-496d38f688fe', '233dd304-c549-40d9-b897-23c4bd8b6f20', 'cc63e082-09d8-4649-804f-f344472acd6a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Delete snapshot completed successfully. Aug 05 15:58:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e554384c-fb50-4c32-9854-e09c9024200f tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-17b798e8-440a-4f3d-b3c2-195664cf7a79-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "cinder-67cd3882-6f15-41af-b52f-10213751def3-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-67cd3882-6f15-41af-b52f-10213751def3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea7f1a-4cfe-4d24-a39b-a93aa962a7f9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:22 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 Aug 05 15:58:22 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Flow 'volume_create_manager' (44bf8038-3ca0-4360-a672-4a92228fb660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f31cfb-0813-4959-83dc-61b96e7dece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f31cfb-0813-4959-83dc-61b96e7dece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1203347878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5086c2-f68e-49f8-9a2b-21d619eb7d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9edeaae2b404e608549f3c3df1498bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:22Z,use_quota=True,user_id='1802f69707d840e3af32d406f63000e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07445e6f-6e70-4ea9-9cef-217a04f50ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07445e6f-6e70-4ea9-9cef-217a04f50ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a77908-749b-49a3-a88b-baf2e7f2afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:58:22 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3" returned: 0 in 0.511s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:22 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3 Aug 05 15:58:22 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:22 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-67cd3882-6f15-41af-b52f-10213751def3" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-quobyte-67cd3882-6f15-41af-b52f-10213751def3" released by "delete_volume" :: held 0.874s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Created reservations ['c61e8bda-e87d-444c-82c0-68466ae04caa', 'ad41fa92-83cc-45e8-84e8-112d8bb32752', '814b23c8-65a3-4f25-ae70-d99fb02e15bc', 'b2d615c4-d4e2-48cb-959a-a05a686788d4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:22 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:22 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a77908-749b-49a3-a88b-baf2e7f2afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'volume_name': 'volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5c05ab-a682-4922-a03b-b065ac3a9a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5c05ab-a682-4922-a03b-b065ac3a9a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679669eb-922a-4710-9413-400aa6b0dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:23 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Trying to clone 6e5086c2-f68e-49f8-9a2b-21d619eb7d27 from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:58:23 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.369s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Deleted volume successfully. Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5de790ab-4107-4aa6-b856-24ce210bc58d tempest-VolumesSnapshotNegativeTestJSON-11821259 None] Lock "cinder-67cd3882-6f15-41af-b52f-10213751def3-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:58:23 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a8aeb-7707-4bb7-a62a-1a08250ff925]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:23 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD Aug 05 15:58:23 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:24 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad is fetched for user 1802f69707d840e3af32d406f63000e0. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8f996d-5cc9-4065-a8fe-847500832e4b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:24 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD Aug 05 15:58:24 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:24 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1203347878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5086c2-f68e-49f8-9a2b-21d619eb7d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9edeaae2b404e608549f3c3df1498bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:22Z,use_quota=True,user_id='1802f69707d840e3af32d406f63000e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Creating volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:24 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:24 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1073741824 Aug 05 15:58:24 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Flow 'volume_create_manager' (c0fd4cdb-ae6e-4816-8a1c-83082d6d433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577039c3-b8dc-47e6-b6ab-5121a41c4713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577039c3-b8dc-47e6-b6ab-5121a41c4713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-85950149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9016dd61df3841a69c00641c8123b264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:25Z,use_quota=True,user_id='3367aea1b4574356896c94653d27632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f8e95a-6146-4c3b-a83c-e893ffb72759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f8e95a-6146-4c3b-a83c-e893ffb72759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de2b6ae-e825-4b9c-b71d-77790b930e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:58:25 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1073741824" returned: 0 in 0.640s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:25 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:25 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:25 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.307s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Attempting download of 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18a9a5a-0555-4220-b208-f062f226d8e0]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de2b6ae-e825-4b9c-b71d-77790b930e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0', 'volume_name': 'volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b016a02-74ca-4773-99d0-dd1ffb26878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b016a02-74ca-4773-99d0-dd1ffb26878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44baf507-bca1-4cd6-9da3-8f52a99e480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:25 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:58:25 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Trying to clone 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:58:25 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm Aug 05 15:58:25 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:26 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm" returned: 0 in 0.515s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:58:26 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e899327-e6ae-44cd-97d7-4334cc6d7191]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:26 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm Aug 05 15:58:26 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:26 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD Aug 05 15:58:26 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:26 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm" returned: 1 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_kzw7hcjm' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1a914-fd09-4a03-be09-781703f64145]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:26 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad is fetched for user 3367aea1b4574356896c94653d27632b. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:58:26 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD Aug 05 15:58:26 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e8ff7-1e66-4f9e-bfe1-2118d8e85b5f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:26 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD Aug 05 15:58:26 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:27 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:27 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:27 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:27 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-85950149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9016dd61df3841a69c00641c8123b264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:25Z,use_quota=True,user_id='3367aea1b4574356896c94653d27632b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Creating volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:27 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:27 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1073741824 Aug 05 15:58:27 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:27 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1073741824" returned: 0 in 0.733s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:28 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:28 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:28 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Attempting download of 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de5b9b1-fd1b-4f05-b957-f447e1c9babf]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:28 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu Aug 05 15:58:28 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:29 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:29 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu Aug 05 15:58:29 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:29 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 2.107s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_bgnic4sadevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:58:29 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Converted 112.00 MB image at 53.09 MB/s Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:29 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1G Aug 05 15:58:29 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:29 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu" returned: 1 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_97ff7rnu' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[df795c4b-1138-4513-84f2-2432e647f35c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:29 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD Aug 05 15:58:29 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:29 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 1G" returned: 0 in 0.435s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b85f2e2-4cae-4bb9-9793-5672f33c994e]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:29 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:58:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:29 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:29 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:29 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:29 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:30 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.460s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:30 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:30 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:30 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 1 in 0.495s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Downloaded image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad for user 1802f69707d840e3af32d406f63000e0 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Marking volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Copying metadata from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad to 6e5086c2-f68e-49f8-9a2b-21d619eb7d27. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Creating volume glance metadata for volume 6e5086c2-f68e-49f8-9a2b-21d619eb7d27 backed by image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679669eb-922a-4710-9413-400aa6b0dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96958a-bce6-48f5-9223-9f103fea81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Volume volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 (6e5086c2-f68e-49f8-9a2b-21d619eb7d27): created successfully Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96958a-bce6-48f5-9223-9f103fea81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Flow 'volume_create_manager' (44bf8038-3ca0-4360-a672-4a92228fb660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-30892d90-5f9e-40b0-8af9-417102e3220b tempest-TestShelveInstance-450959933 None] Created volume successfully. Aug 05 15:58:31 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 0 in 1.905s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:31 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_566b9ff7-fa4a-4447-b63c-55a0e34fc6ad_tg0p5lp3devstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:58:31 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Converted 112.00 MB image at 58.77 MB/s Aug 05 15:58:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:31 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1G Aug 05 15:58:31 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:32 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 1G" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7413dbc0-3d71-43c1-aa83-5dae248f00a3]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:32 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:32 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:32 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 0 in 0.443s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:32 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:32 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:33 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 1 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Downloaded image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad ((None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}])) to volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Temporary image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad for user 3367aea1b4574356896c94653d27632b is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Marking volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Copying metadata from image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad to 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Creating volume glance metadata for volume 8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 backed by image 566b9ff7-fa4a-4447-b63c-55a0e34fc6ad with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44baf507-bca1-4cd6-9da3-8f52a99e480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0', 'volume_size': 1, 'image_id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd65f997917844d61b90d12180c2da200', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '566b9ff7-fa4a-4447-b63c-55a0e34fc6ad', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/566b9ff7-fa4a-4447-b63c-55a0e34fc6ad/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52372671-cef4-4b00-be8d-b23576837b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Volume volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 (8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0): created successfully Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52372671-cef4-4b00-be8d-b23576837b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Flow 'volume_create_manager' (c0fd4cdb-ae6e-4816-8a1c-83082d6d433a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0117f7b1-87ef-4591-bf16-976705ab5dd8 tempest-VolumesImageMetadata-1168842662 None] Created volume successfully. Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab0ad3-d8ce-45b9-8688-3b6054d378df]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Acquiring lock "cinder-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "cinder-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:34 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:34 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Acquiring lock "cinder-quobyte-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "cinder-quobyte-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[457aebe0-7a1c-4925-a2fe-5cde28819775]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:34 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:34 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:34 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.589s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:34 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:58:34 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:35 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 0 in 0.537s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:35 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:35 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:35 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 1 in 0.579s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.241s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8af36bb0-4a98-416a-bff6-85f1e6d0ae8f', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:58:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-6940e209-fc0c-4f77-a337-093ed95537fc req-f657c9d2-f19f-4954-bfcf-ab8f31ed6669 tempest-TestShelveInstance-450959933 None] attachment_update completed successfully. Aug 05 15:58:35 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 1 in 0.516s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:35 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0 Aug 05 15:58:35 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:35 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "cinder-quobyte-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0" released by "delete_volume" :: held 1.504s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:35 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Created reservations ['8376fdc0-3a04-48df-97a9-e5bcfddfc55c', '9ba650b5-792c-4e8e-bb52-e786454c1a40', '3e4da710-0eab-4b3f-ae9c-bb3db8dc874e', '92d35922-4af4-4a3d-b063-2bcad95a2ef1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:36 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:58:36 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:36 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:58:36 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Deleted volume successfully. Aug 05 15:58:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-060c7a49-967f-414e-acce-1709d0fe01f9 tempest-VolumesImageMetadata-1168842662 None] Lock "cinder-8fe5ecd4-ded6-4374-ad0a-c4bde9d88de0-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (2487ecb4-7ecc-46b3-bcb6-8cbb5f2b5f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182d089b-72c2-434f-a819-db024528d9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182d089b-72c2-434f-a819-db024528d9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-184840500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8305a6-598a-406f-8c85-442dea3e11ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d91f5d23ab4a05bd65400e23e01744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:42Z,use_quota=True,user_id='f909c9917bc44c34a4a069088eaba7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a486eb7f-cb48-409a-91d2-2844ad304cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a486eb7f-cb48-409a-91d2-2844ad304cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028da5b6-c93c-43c0-a3fd-dcac814a14b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028da5b6-c93c-43c0-a3fd-dcac814a14b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8305a6-598a-406f-8c85-442dea3e11ce', 'volume_name': 'volume-bc8305a6-598a-406f-8c85-442dea3e11ce', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d97298-140b-41af-be16-08f5b68d554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d97298-140b-41af-be16-08f5b68d554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acea1406-328a-424e-8f2b-d220d9cd6323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:41 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Volume bc8305a6-598a-406f-8c85-442dea3e11ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8305a6-598a-406f-8c85-442dea3e11ce', 'volume_size': 1} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-184840500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8305a6-598a-406f-8c85-442dea3e11ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d91f5d23ab4a05bd65400e23e01744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:42Z,use_quota=True,user_id='f909c9917bc44c34a4a069088eaba7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Creating volume bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:41 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:41 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce 1073741824 Aug 05 15:58:41 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:42 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce 1073741824" returned: 0 in 0.565s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:42 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:58:42 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:42 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acea1406-328a-424e-8f2b-d220d9cd6323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8305a6-598a-406f-8c85-442dea3e11ce', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeb25e4-576f-4cb7-98c3-c253009cc25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:42 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Volume volume-bc8305a6-598a-406f-8c85-442dea3e11ce (bc8305a6-598a-406f-8c85-442dea3e11ce): created successfully Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeb25e4-576f-4cb7-98c3-c253009cc25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (2487ecb4-7ecc-46b3-bcb6-8cbb5f2b5f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:42 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2c48a7c4-7c71-4bc3-a034-ff965b0887db tempest-VolumesDeleteCascade-1130717780 None] Created volume successfully. Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Creating offline snapshot 0f7bfb0a-98ab-40a5-b5ee-403247200a50 of volume bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b7236-49b1-4cc6-8b78-ca5dbd6922c2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:44 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:58:44 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:44 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.566s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:44 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 1G Aug 05 15:58:44 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:45 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 1G" returned: 0 in 0.528s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:45 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:45 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:46 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.711s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:46 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 is being set with open permissions: ugo+rw Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:46 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:46 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:46 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.448s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:46 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info Aug 05 15:58:46 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:46 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info" returned: 0 in 0.423s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:46 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info is being set with open permissions: ugo+rw Aug 05 15:58:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:47 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info Aug 05 15:58:47 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:47 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.info" returned: 0 in 0.406s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f0b4bb9f-2203-461d-86d5-3c68894c5f18 tempest-VolumesDeleteCascade-1130717780 None] Create snapshot completed successfully Aug 05 15:58:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Creating offline snapshot d4e0c5e0-710d-4d72-8623-96253ee11b47 of volume bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:58:48 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b154075-c190-4354-ae21-7feb7bf2296d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:48 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:48 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:49 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.616s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8305a6-598a-406f-8c85-442dea3e11ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:49 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 1G Aug 05 15:58:49 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:50 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 1G" returned: 0 in 0.886s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:50 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:58:50 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Flow 'volume_create_manager' (2e77fd13-9d86-4409-9eae-2449c76235d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda2c5a-9a36-4e28-b4e0-69a27031152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:50 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 0.599s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:50 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 is being set with open permissions: ugo+rw Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda2c5a-9a36-4e28-b4e0-69a27031152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-10744393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613915bb-58a7-4033-879b-a822d8d5b65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b19146e4ac74fcb90a0c2804ff590d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:51Z,use_quota=True,user_id='5427f7eab14f43059a830c7076813186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69a56ff-dbb8-445b-aa78-9dcdefa7e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69a56ff-dbb8-445b-aa78-9dcdefa7e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:51 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:58:51 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f744b9cb-4f07-4d0b-b6ea-96d61800fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f744b9cb-4f07-4d0b-b6ea-96d61800fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613915bb-58a7-4033-879b-a822d8d5b65f', 'volume_name': 'volume-613915bb-58a7-4033-879b-a822d8d5b65f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cf3d81-cf20-409f-a553-ef9171fa628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cf3d81-cf20-409f-a553-ef9171fa628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a5dfab-997e-4dd0-86c4-337ca419108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:51 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Volume 613915bb-58a7-4033-879b-a822d8d5b65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613915bb-58a7-4033-879b-a822d8d5b65f', 'volume_size': 1} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:51 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 0.335s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-10744393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613915bb-58a7-4033-879b-a822d8d5b65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b19146e4ac74fcb90a0c2804ff590d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:58:51Z,use_quota=True,user_id='5427f7eab14f43059a830c7076813186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Creating volume 613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:58:51 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:51 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f 1073741824 Aug 05 15:58:51 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fcc2557d-57a5-4413-bdf9-97cc715c2700 tempest-VolumesDeleteCascade-1130717780 None] Create snapshot completed successfully Aug 05 15:58:51 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f 1073741824" returned: 0 in 0.639s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-bc8305a6-598a-406f-8c85-442dea3e11ce-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-bc8305a6-598a-406f-8c85-442dea3e11ce-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:52 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Performing cascade delete. {{(pid=88715) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 15:58:52 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-0f7bfb0a-98ab-40a5-b5ee-403247200a50-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-0f7bfb0a-98ab-40a5-b5ee-403247200a50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-0f7bfb0a-98ab-40a5-b5ee-403247200a50" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f7bfb0a-98ab-40a5-b5ee-403247200a50" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Deleting offline snapshot 0f7bfb0a-98ab-40a5-b5ee-403247200a50 of volume bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] snapshot_file for this snap is: volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7511e63-f907-4e63-b6fb-df3cb20c0f89]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:52 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:52 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:52 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a5dfab-997e-4dd0-86c4-337ca419108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613915bb-58a7-4033-879b-a822d8d5b65f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de835349-2db4-46d4-93b0-7ce391359128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:58:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Volume volume-613915bb-58a7-4033-879b-a822d8d5b65f (613915bb-58a7-4033-879b-a822d8d5b65f): created successfully Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de835349-2db4-46d4-93b0-7ce391359128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Flow 'volume_create_manager' (2e77fd13-9d86-4409-9eae-2449c76235d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:58:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1e10b560-bd86-4509-abb1-b953fcec5cfa tempest-TestImageHashVerification-1861382057 None] Created volume successfully. Aug 05 15:58:52 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8305a6-598a-406f-8c85-442dea3e11ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b3ffc-8fab-484d-9a1d-3f42f2a8fd86]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:53 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:58:53 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:53 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.612s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac77a3-7925-4f9e-b92e-deb7e5f4a908]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:53 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:58:53 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:54 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 0.537s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8305a6-598a-406f-8c85-442dea3e11ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45c695-7d5a-4ef8-9854-a34dac46278e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c8affb-3f02-42f1-b3ce-3170cc839b1d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:54 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:54 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:54 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:58:54 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:54 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.446s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8305a6-598a-406f-8c85-442dea3e11ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:54 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7554afa3-8416-4715-93ae-159767c0eea8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8327af1-04af-4919-9dd5-2e25eaf17880]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:54 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:58:54 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:54 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:58:54 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:55 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.397s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:55 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f /opt/stack/data/cinder/conversion/613915bb-58a7-4033-879b-a822d8d5b65f.temp_image.d9a670ac-34b5-4b61-956d-b599890369f60fkcm6bm.img {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:55 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:55 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:55 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f /opt/stack/data/cinder/conversion/613915bb-58a7-4033-879b-a822d8d5b65f.temp_image.d9a670ac-34b5-4b61-956d-b599890369f60fkcm6bm.img Aug 05 15:58:55 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:55 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.370s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:55 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50 Aug 05 15:58:55 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:56 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.0f7bfb0a-98ab-40a5-b5ee-403247200a50" returned: 0 in 0.669s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 -F qcow2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:56 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 -F qcow2 Aug 05 15:58:56 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:57 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc8305a6-598a-406f-8c85-442dea3e11ce /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 -F qcow2" returned: 0 in 0.985s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f7bfb0a-98ab-40a5-b5ee-403247200a50" released by "_delete_snapshot" :: held 4.871s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" released by "delete_snapshot" :: held 4.914s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['2a3bdc0c-f051-4d19-8660-a92899554fc6', '97572ce0-cb35-42df-9aeb-4d5902aeff82', 'c4443730-e140-4330-97bc-458f4be0b92d', '1b537f2b-5b29-4aca-9902-6530842ecffe'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:58:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Delete snapshot completed successfully. Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-0f7bfb0a-98ab-40a5-b5ee-403247200a50-delete_snapshot" released by "delete_snapshot" :: held 5.421s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-d4e0c5e0-710d-4d72-8623-96253ee11b47-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-d4e0c5e0-710d-4d72-8623-96253ee11b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-d4e0c5e0-710d-4d72-8623-96253ee11b47" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-d4e0c5e0-710d-4d72-8623-96253ee11b47" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Deleting offline snapshot d4e0c5e0-710d-4d72-8623-96253ee11b47 of volume bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] snapshot_file for this snap is: volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789e029-4e30-4b3e-8bd1-fa1f07c54dc6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:58 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:58:58 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:58 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 1.006s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc8305a6-598a-406f-8c85-442dea3e11ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:58:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79cc4dc-9f6b-4845-829d-c01eda28cb07]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:58:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:58:59 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:58:59 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:58:59 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Aug 05 15:58:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.890s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:58:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:00 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:59:00 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:00 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 0.801s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:00 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47 Aug 05 15:59:00 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:00 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f /opt/stack/data/cinder/conversion/613915bb-58a7-4033-879b-a822d8d5b65f.temp_image.d9a670ac-34b5-4b61-956d-b599890369f60fkcm6bm.img" returned: 0 in 5.802s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db31b9-4a7b-4425-8127-046a599958d5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:01 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:59:01 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:01 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce.d4e0c5e0-710d-4d72-8623-96253ee11b47" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-d4e0c5e0-710d-4d72-8623-96253ee11b47" released by "_delete_snapshot" :: held 3.242s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" released by "delete_snapshot" :: held 3.313s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['a36ded6d-e49e-48b9-b4d8-d3fafbb6dc8b', '5f9441a6-8e04-42c7-83f1-03aa3eec5f67', 'ef7127a0-d116-49b1-90f1-14f1c956fefd', '9edbb381-e9fe-469a-9b33-a31b353e4384'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Delete snapshot completed successfully. Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-d4e0c5e0-710d-4d72-8623-96253ee11b47-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Snapshots deleted, issuing volume delete {{(pid=88715) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f3885f-5d22-45a7-85b6-df8a14028e63]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:01 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:59:01 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:01 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.578s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/613915bb-58a7-4033-879b-a822d8d5b65f.temp_image.d9a670ac-34b5-4b61-956d-b599890369f60fkcm6bm.img {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:59:01 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Converted 1024.00 MB image at 176.45 MB/s Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] d9a670ac-34b5-4b61-956d-b599890369f6 was raw, no need to convert to raw {{(pid=88715) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 15:59:01 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:01 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce Aug 05 15:59:01 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:01 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bc8305a6-598a-406f-8c85-442dea3e11ce" returned: 0 in 0.273s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-bc8305a6-598a-406f-8c85-442dea3e11ce" released by "delete_volume" :: held 0.724s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['f331dc21-454e-4cc2-b769-e284fa4b89b0', 'e148f077-c50b-4775-82bb-172db23bbc3e', '9ff067ad-fec0-47a9-8351-85a8481ec166', 'c1d7e5c3-ed8c-40b3-a3c3-c8ce90ecf154'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:02 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:02 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:02 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Deleted volume successfully. Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f322164-9171-4d58-b672-084d88b7f8d4 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-bc8305a6-598a-406f-8c85-442dea3e11ce-delete_volume" released by "delete_volume" :: held 10.386s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (80007943-1884-48fe-a7a3-b690c84c20cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c78435-bd95-41d6-b8a7-6adaa84279a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c78435-bd95-41d6-b8a7-6adaa84279a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1502926715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef30e750-7ce8-4f2b-a7f3-d997559157fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d91f5d23ab4a05bd65400e23e01744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:03Z,use_quota=True,user_id='f909c9917bc44c34a4a069088eaba7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe37fa0-2e1a-47a5-a5e6-8a9a9d6f2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe37fa0-2e1a-47a5-a5e6-8a9a9d6f2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb2676e-f8fd-44ef-99db-27ecc488331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb2676e-f8fd-44ef-99db-27ecc488331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef30e750-7ce8-4f2b-a7f3-d997559157fc', 'volume_name': 'volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8375fbdc-26eb-473e-ab59-b9c0b5737a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8375fbdc-26eb-473e-ab59-b9c0b5737a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571cc5da-642b-4ba0-98c1-90e142f5fefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:03 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Volume ef30e750-7ce8-4f2b-a7f3-d997559157fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc', 'volume_size': 1} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:03 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:03 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:03 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.260s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:59:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:59:12 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=97,cinder:INSERT=29,cinder:UPDATE=103,cinder:DELETE=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:59:12 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=98,cinder:INSERT=52,cinder:UPDATE=89,cinder:DELETE=7 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:59:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-ed568b59-acfb-4b7c-ba81-3dfcea9c8410 req-55bf250d-71c7-4a35-91aa-e50744a62b94 tempest-TestShelveInstance-450959933 None] Terminate volume connection completed successfully. Aug 05 15:59:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-ed568b59-acfb-4b7c-ba81-3dfcea9c8410 req-55bf250d-71c7-4a35-91aa-e50744a62b94 tempest-TestShelveInstance-450959933 None] Deleting attachment 8af36bb0-4a98-416a-bff6-85f1e6d0ae8f. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:59:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.831s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Uploaded volume to glance image-id: d9a670ac-34b5-4b61-956d-b599890369f6. {{(pid=88715) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.096s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1502926715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef30e750-7ce8-4f2b-a7f3-d997559157fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d91f5d23ab4a05bd65400e23e01744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:03Z,use_quota=True,user_id='f909c9917bc44c34a4a069088eaba7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Creating volume ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:59:21 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d498112e-a660-41c7-a808-b36d12a4a1e6 tempest-TestImageHashVerification-1861382057 None] Copy volume to image completed successfully. Aug 05 15:59:21 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc 1073741824 Aug 05 15:59:21 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:21 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc 1073741824" returned: 0 in 0.442s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:21 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:21 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:21 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.531s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571cc5da-642b-4ba0-98c1-90e142f5fefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fdd242-4052-437d-9cdb-6627800167dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:21 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Volume volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc (ef30e750-7ce8-4f2b-a7f3-d997559157fc): created successfully Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fdd242-4052-437d-9cdb-6627800167dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (80007943-1884-48fe-a7a3-b690c84c20cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9626b612-9814-4186-a34b-38141624ffda]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6835a132-4cea-475f-8c50-1b2a35b9fb41 tempest-VolumesDeleteCascade-1130717780 None] Created volume successfully. Aug 05 15:59:22 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:59:22 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Acquiring lock "cinder-613915bb-58a7-4033-879b-a822d8d5b65f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "cinder-613915bb-58a7-4033-879b-a822d8d5b65f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Acquiring lock "cinder-quobyte-613915bb-58a7-4033-879b-a822d8d5b65f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "cinder-quobyte-613915bb-58a7-4033-879b-a822d8d5b65f" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8edf4-0e52-41e7-a2ce-24bc6a38c55f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:22 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.415s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:22 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:59:22 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:22 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 15:59:22 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:22 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:22 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f Aug 05 15:59:22 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:22 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 1 in 0.416s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.278s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Creating offline snapshot aaae387d-444b-45ea-ae72-23b91c68fb7a of volume ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e22ad-4b54-4d52-b96f-6d73a1133221]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ebd6ea-324b-438b-9277-f2fde0cd8308', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:59:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-31e7b1df-45be-4a9a-8ab7-8e96d01c5ed9 req-a7c2020d-a01f-4af3-ada5-d80cccf9b58d tempest-TestShelveInstance-450959933 None] attachment_update completed successfully. Aug 05 15:59:22 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-613915bb-58a7-4033-879b-a822d8d5b65f" returned: 0 in 0.272s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:22 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:22 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "cinder-quobyte-613915bb-58a7-4033-879b-a822d8d5b65f" released by "delete_volume" :: held 0.745s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Created reservations ['25b5cff5-6ec1-4ca4-ba65-cdbaa17a887d', 'cbd880bf-fcf0-4ebe-a9d0-0b39df1c99b1', 'fd630b16-8bee-4946-a3d0-d52e7c3cb36d', 'a578848a-53be-4441-b352-af6eabdedd2a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:23 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:23 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:23 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.427s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:23 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a 1G Aug 05 15:59:23 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:23 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Deleted volume successfully. Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d629f254-9083-4dc1-a349-1d61e5ec718e tempest-TestImageHashVerification-1861382057 None] Lock "cinder-613915bb-58a7-4033-879b-a822d8d5b65f-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:23 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a 1G" returned: 0 in 0.520s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:23 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:23 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:24 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.339s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:24 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a is being set with open permissions: ugo+rw Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:24 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:24 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:24 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.302s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:24 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info Aug 05 15:59:24 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:24 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info" returned: 0 in 0.297s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:24 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info is being set with open permissions: ugo+rw Aug 05 15:59:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:24 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info Aug 05 15:59:24 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:25 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.info" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5cce5c8-ae22-4abb-a614-d3101a6ea6a7 tempest-VolumesDeleteCascade-1130717780 None] Create snapshot completed successfully Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (cc552b3a-6038-49df-9c28-c922720a1124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33913d57-ff52-48d4-943c-cff8877897d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33913d57-ff52-48d4-943c-cff8877897d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1963220315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e8f51-3dc0-4a63-bd7a-82bd67165332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d91f5d23ab4a05bd65400e23e01744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaae387d-444b-45ea-ae72-23b91c68fb7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:26Z,use_quota=True,user_id='f909c9917bc44c34a4a069088eaba7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9606c0-1768-401a-ae10-c224ad461a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9606c0-1768-401a-ae10-c224ad461a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43effa5-fbcc-415a-bfb7-a6ab6a125e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43effa5-fbcc-415a-bfb7-a6ab6a125e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f6e8f51-3dc0-4a63-bd7a-82bd67165332', 'volume_name': 'volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332', 'volume_size': 1, 'snapshot_id': 'aaae387d-444b-45ea-ae72-23b91c68fb7a'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e254889-0439-43b2-a5dd-fb2f2ad1daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e254889-0439-43b2-a5dd-fb2f2ad1daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b89d9f-2331-4cec-9e0f-122ea4f72ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Volume 0f6e8f51-3dc0-4a63-bd7a-82bd67165332: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332', 'volume_size': 1, 'snapshot_id': 'aaae387d-444b-45ea-ae72-23b91c68fb7a'} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Creating volume 0f6e8f51-3dc0-4a63-bd7a-82bd67165332 from snapshot aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] snapshot: aaae387d-444b-45ea-ae72-23b91c68fb7a, volume: 0f6e8f51-3dc0-4a63-bd7a-82bd67165332, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9f73e-437d-436e-bb42-10cb6113bf3a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:27 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:27 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:27 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.438s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7bdc5-daa1-4194-be82-0b9ea830e63f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:27 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:27 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:27 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.394s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:59:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:27 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 Aug 05 15:59:27 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:34 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" returned: 0 in 6.685s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905f44e-2f15-4f19-b4ea-22e20ea0e960]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:34 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:34 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:35 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.628s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:59:35 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Converted 1024.00 MB image at 153.15 MB/s Aug 05 15:59:35 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 is being set with open permissions: ugo+rw Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:35 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 Aug 05 15:59:35 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:35 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" released by "_copy_volume_from_snapshot" :: held 8.590s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" released by "_create_volume_from_snapshot" :: held 8.640s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.663s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b89d9f-2331-4cec-9e0f-122ea4f72ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332', 'volume_size': 1, 'snapshot_id': 'aaae387d-444b-45ea-ae72-23b91c68fb7a'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c8a51b-f3ad-4cd5-b627-ea53db140b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Volume volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 (0f6e8f51-3dc0-4a63-bd7a-82bd67165332): created successfully Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c8a51b-f3ad-4cd5-b627-ea53db140b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Flow 'volume_create_manager' (cc552b3a-6038-49df-9c28-c922720a1124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-91bf771e-5cec-414f-9c6c-e5b8302dc0b7 tempest-VolumesDeleteCascade-1130717780 None] Created volume successfully. Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-ef30e750-7ce8-4f2b-a7f3-d997559157fc-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-ef30e750-7ce8-4f2b-a7f3-d997559157fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Performing cascade delete. {{(pid=88715) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-aaae387d-444b-45ea-ae72-23b91c68fb7a-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-aaae387d-444b-45ea-ae72-23b91c68fb7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Deleting offline snapshot aaae387d-444b-45ea-ae72-23b91c68fb7a of volume ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] snapshot_file for this snap is: volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928e506-2162-4eea-9695-f7b666b5fd23]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:36 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:36 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:36 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fc326b-722c-44f3-8f93-f00826898d89]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:36 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:36 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:37 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.443s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:37 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:37 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:37 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:37 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a Aug 05 15:59:37 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:37 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc.aaae387d-444b-45ea-ae72-23b91c68fb7a" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-aaae387d-444b-45ea-ae72-23b91c68fb7a" released by "_delete_snapshot" :: held 1.540s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" released by "delete_snapshot" :: held 1.569s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['e857960f-5479-4abf-b8d7-a5e8e1a53b29', '46bf8bc9-ea8f-47f6-92a7-c3f167efd393', '40f97862-b885-419b-81da-293a049836e9', '77717d02-7549-4c89-b4c3-f548a1763e60'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Delete snapshot completed successfully. Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-aaae387d-444b-45ea-ae72-23b91c68fb7a-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Snapshots deleted, issuing volume delete {{(pid=88715) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[56277cae-b134-47ff-a0e2-59695f213b19]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:38 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:38 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:38 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.440s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:38 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc Aug 05 15:59:38 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:38 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ef30e750-7ce8-4f2b-a7f3-d997559157fc" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-ef30e750-7ce8-4f2b-a7f3-d997559157fc" released by "delete_volume" :: held 0.858s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['51aa65bb-0d8e-4a70-93f6-002f7f40f3bb', 'f1498f2e-0428-474d-b077-ed1e33d7a2ac', 'a354ce55-6105-4851-b940-b61ad67ea206', '658725fe-2f0e-41e8-997d-8a5e7e31934e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:38 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:38 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:39 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Deleted volume successfully. Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-afe4fead-6346-419e-9111-ade988ac8583 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-ef30e750-7ce8-4f2b-a7f3-d997559157fc-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-0f6e8f51-3dc0-4a63-bd7a-82bd67165332-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-0f6e8f51-3dc0-4a63-bd7a-82bd67165332-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[886270a7-1a22-48f5-939d-4698cfaa6b6e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:39 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 Aug 05 15:59:39 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:40 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" returned: 0 in 0.406s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:40 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332 Aug 05 15:59:40 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:40 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" returned: 0 in 0.258s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-quobyte-0f6e8f51-3dc0-4a63-bd7a-82bd67165332" released by "delete_volume" :: held 0.707s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Created reservations ['b9b37800-d7f6-457c-aa04-47acceca4890', 'c887a3fc-a696-450f-90d8-a6e62ade2ab9', '7788db5c-f125-441a-aa77-60d3547af0e6', 'bd4d5751-2433-45d7-ae9f-ddbd5cef1728'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:40 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:40 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:40 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.304s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Deleted volume successfully. Aug 05 15:59:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea04b98c-d377-403b-9e32-159529b9b937 tempest-VolumesDeleteCascade-1130717780 None] Lock "cinder-0f6e8f51-3dc0-4a63-bd7a-82bd67165332-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Flow 'volume_create_manager' (939cc776-e2d4-4f3c-9a2a-94bd54ad4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ecf862-8104-49e3-8251-fff8037c658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ecf862-8104-49e3-8251-fff8037c658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1045009285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f82cb48-4a31-44ae-939b-281ede774d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a49c273a62460f893ce874333e418b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:44Z,use_quota=True,user_id='88279734c5c74b12baae01eb1273d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73844e1-0694-41bd-b851-1d8a6f5a51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73844e1-0694-41bd-b851-1d8a6f5a51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422de7a0-00c8-48c8-86cc-e3b8e31aa630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422de7a0-00c8-48c8-86cc-e3b8e31aa630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f82cb48-4a31-44ae-939b-281ede774d5a', 'volume_name': 'volume-3f82cb48-4a31-44ae-939b-281ede774d5a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca0de4-d8b9-4d53-8bc3-bbcffc961e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca0de4-d8b9-4d53-8bc3-bbcffc961e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3fa5aa-ba10-44e6-a2ae-63b2114c5ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:44 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Volume 3f82cb48-4a31-44ae-939b-281ede774d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f82cb48-4a31-44ae-939b-281ede774d5a', 'volume_size': 1} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1045009285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f82cb48-4a31-44ae-939b-281ede774d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a49c273a62460f893ce874333e418b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:44Z,use_quota=True,user_id='88279734c5c74b12baae01eb1273d67e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Creating volume 3f82cb48-4a31-44ae-939b-281ede774d5a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:59:44 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:44 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a 1073741824 Aug 05 15:59:44 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:44 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a 1073741824" returned: 0 in 0.482s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:44 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a Aug 05 15:59:44 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:45 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3fa5aa-ba10-44e6-a2ae-63b2114c5ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f82cb48-4a31-44ae-939b-281ede774d5a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c57a5-3998-4f12-97e2-a41e18da8988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:45 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Volume volume-3f82cb48-4a31-44ae-939b-281ede774d5a (3f82cb48-4a31-44ae-939b-281ede774d5a): created successfully Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c57a5-3998-4f12-97e2-a41e18da8988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Flow 'volume_create_manager' (939cc776-e2d4-4f3c-9a2a-94bd54ad4f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2a3dfe9f-3992-49dc-9924-56d3fbac2680 tempest-VolumesMetadataTest-1896573166 None] Created volume successfully. Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Acquiring lock "cinder-3f82cb48-4a31-44ae-939b-281ede774d5a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "cinder-3f82cb48-4a31-44ae-939b-281ede774d5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Acquiring lock "cinder-quobyte-3f82cb48-4a31-44ae-939b-281ede774d5a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "cinder-quobyte-3f82cb48-4a31-44ae-939b-281ede774d5a" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55bd5f0-23c3-4dcc-9934-512392ad3f46]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:47 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a Aug 05 15:59:47 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:47 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a" returned: 0 in 0.451s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:47 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a Aug 05 15:59:47 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:47 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3f82cb48-4a31-44ae-939b-281ede774d5a" returned: 0 in 0.324s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "cinder-quobyte-3f82cb48-4a31-44ae-939b-281ede774d5a" released by "delete_volume" :: held 0.831s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Created reservations ['fa74882a-5eff-40a7-9b4b-3f180362928c', '53ab3400-2ab0-40ef-ab1f-66241cee6c9a', 'a4aa9cd5-8afb-4a59-8e2e-5ab8a174c140', '50e1a28f-43a0-4846-867e-6808aa5624be'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:48 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:48 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:48 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:48 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Deleted volume successfully. Aug 05 15:59:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c476cb3e-f000-4afc-b8a4-969409266880 tempest-VolumesMetadataTest-1896573166 None] Lock "cinder-3f82cb48-4a31-44ae-939b-281ede774d5a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Flow 'volume_create_manager' (f94d94f4-0e73-4021-ad92-bba254bbf494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec05121c-d42f-4a42-b161-aad901fdd34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec05121c-d42f-4a42-b161-aad901fdd34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1082636173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34dffa93ba64c3d995068ffa6726943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:54Z,use_quota=True,user_id='7e76c30fb38240ef92cbc7809fc70bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296e9c2a-81e9-4e6f-8580-9d2096fd0208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296e9c2a-81e9-4e6f-8580-9d2096fd0208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2893fc75-818a-4e39-8a0e-9183686eebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2893fc75-818a-4e39-8a0e-9183686eebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b', 'volume_name': 'volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb23dc9-0976-4ce8-8aef-74018537b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb23dc9-0976-4ce8-8aef-74018537b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4d689b-4a7b-4d2e-ba7a-d9729c118a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Volume 3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b', 'volume_size': 1} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1082636173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34dffa93ba64c3d995068ffa6726943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:54Z,use_quota=True,user_id='7e76c30fb38240ef92cbc7809fc70bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Creating volume 3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:59:54 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:54 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b 1073741824 Aug 05 15:59:54 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:54 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b 1073741824" returned: 0 in 0.453s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:54 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b Aug 05 15:59:54 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:55 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" returned: 0 in 0.244s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4d689b-4a7b-4d2e-ba7a-d9729c118a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096fa3a1-8d01-4748-a990-ddcde42e5862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:55 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Volume volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b (3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b): created successfully Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096fa3a1-8d01-4748-a990-ddcde42e5862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Flow 'volume_create_manager' (f94d94f4-0e73-4021-ad92-bba254bbf494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-238e5a61-c2a7-4b75-a3fc-2032260c234e tempest-VolumesTransfersV357Test-1171036514 None] Created volume successfully. Aug 05 15:59:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b9388099-8ddd-46df-8e62-e1d1c1fb014d tempest-VolumesTransfersV357Test-1744293145 None] Transfer volume completed successfully. Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "cinder-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "cinder-quobyte-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-quobyte-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8546e0d-0147-4a94-bd2d-54b8bd3f0c59]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:56 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b Aug 05 15:59:56 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:56 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" returned: 0 in 0.388s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:56 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b Aug 05 15:59:56 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:57 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-quobyte-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b" released by "delete_volume" :: held 0.686s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Created reservations ['578be9b0-10d9-4513-af84-775a97c6f4af', 'ab7c9af9-4f3c-42ba-83b7-851e086b1674', '00209294-bf85-499b-a714-a6f22af6ddb2', 'dc3262ef-f5b2-4949-b485-87f77e4f6bdc'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:57 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 15:59:57 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:57 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:59:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Deleted volume successfully. Aug 05 15:59:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75583931-437c-412b-a7b0-a31fa07277c5 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-3a26d7ce-f1db-41fd-92c8-ed0ba8ef8d1b-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Flow 'volume_create_manager' (9d3a5ba8-918f-4fc4-8752-733f0b1604ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ec1b61-73fd-4ecb-ade7-fdf2cc32b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ec1b61-73fd-4ecb-ade7-fdf2cc32b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1725881380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958d86b6-6f95-44a6-8143-8e894f8c9bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34dffa93ba64c3d995068ffa6726943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:58Z,use_quota=True,user_id='7e76c30fb38240ef92cbc7809fc70bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc64a0b-ea34-4bdd-bb04-6c16c21ebf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc64a0b-ea34-4bdd-bb04-6c16c21ebf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d612008-e41c-405e-b581-bd55b4225c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d612008-e41c-405e-b581-bd55b4225c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958d86b6-6f95-44a6-8143-8e894f8c9bac', 'volume_name': 'volume-958d86b6-6f95-44a6-8143-8e894f8c9bac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ff971b-fb1d-48e6-831a-e7d5b72dc26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ff971b-fb1d-48e6-831a-e7d5b72dc26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b25717-e6c6-4f82-bc27-0e0b40971612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Volume 958d86b6-6f95-44a6-8143-8e894f8c9bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958d86b6-6f95-44a6-8143-8e894f8c9bac', 'volume_size': 1} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1725881380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958d86b6-6f95-44a6-8143-8e894f8c9bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34dffa93ba64c3d995068ffa6726943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:59:58Z,use_quota=True,user_id='7e76c30fb38240ef92cbc7809fc70bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Creating volume 958d86b6-6f95-44a6-8143-8e894f8c9bac {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 15:59:58 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:58 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac 1073741824 Aug 05 15:59:58 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:58 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac 1073741824" returned: 0 in 0.475s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:59:58 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac Aug 05 15:59:58 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:59:59 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b25717-e6c6-4f82-bc27-0e0b40971612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958d86b6-6f95-44a6-8143-8e894f8c9bac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa2f9c9-2043-42d7-88af-6d5b83d9e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:59:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Volume volume-958d86b6-6f95-44a6-8143-8e894f8c9bac (958d86b6-6f95-44a6-8143-8e894f8c9bac): created successfully Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa2f9c9-2043-42d7-88af-6d5b83d9e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:59:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Flow 'volume_create_manager' (9d3a5ba8-918f-4fc4-8752-733f0b1604ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:59:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cea5262d-62da-4dbc-818e-3d01c4bbf56c tempest-VolumesTransfersV357Test-1171036514 None] Created volume successfully. Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "cinder-958d86b6-6f95-44a6-8143-8e894f8c9bac-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-958d86b6-6f95-44a6-8143-8e894f8c9bac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "cinder-quobyte-958d86b6-6f95-44a6-8143-8e894f8c9bac" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-quobyte-958d86b6-6f95-44a6-8143-8e894f8c9bac" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cb7473-6506-4cbb-acff-18c0232aa2be]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:00 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac Aug 05 16:00:00 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:01 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac" returned: 0 in 0.455s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:01 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac Aug 05 16:00:01 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:01 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-958d86b6-6f95-44a6-8143-8e894f8c9bac" returned: 0 in 0.275s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-quobyte-958d86b6-6f95-44a6-8143-8e894f8c9bac" released by "delete_volume" :: held 0.777s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Created reservations ['55fd892b-524d-4268-a8f6-feaa3139d55c', '8550e1cf-d05e-43cd-bbc2-bb5946cff02a', '1d878487-0f8a-4296-936e-9b81a2cb5c47', '4840dec1-0ca3-40ab-96d2-ef782323aaf7'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:01 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:01 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:01 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.307s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Deleted volume successfully. Aug 05 16:00:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-87665f35-d471-4e92-8f30-cfeb2fd9de26 tempest-VolumesTransfersV357Test-818329368 None] Lock "cinder-958d86b6-6f95-44a6-8143-8e894f8c9bac-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:03 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:03 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:03 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.283s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:00:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Flow 'volume_create_manager' (b34aab28-d1da-44b9-ada8-ce60b36a581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa5f5ff-ba76-4cdd-bfe2-f8af7da23225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa5f5ff-ba76-4cdd-bfe2-f8af7da23225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-30966263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca435c0-e381-4276-ae57-ff2677678c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd3e00fd5bc49a19c47a3cde3331025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:05Z,use_quota=True,user_id='4f2d49371ff647c89926737a71a62ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2234ef1-83af-4cb6-a039-6930cf0501db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2234ef1-83af-4cb6-a039-6930cf0501db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b4836c-6f57-4557-bac1-077ed8cc97cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b4836c-6f57-4557-bac1-077ed8cc97cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca435c0-e381-4276-ae57-ff2677678c87', 'volume_name': 'volume-cca435c0-e381-4276-ae57-ff2677678c87', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc4c759-4f47-4e73-a6d6-9e7e31617614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc4c759-4f47-4e73-a6d6-9e7e31617614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3579838-3800-485b-8362-c81f5c5de9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Volume cca435c0-e381-4276-ae57-ff2677678c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca435c0-e381-4276-ae57-ff2677678c87', 'volume_size': 1} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-30966263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca435c0-e381-4276-ae57-ff2677678c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd3e00fd5bc49a19c47a3cde3331025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:05Z,use_quota=True,user_id='4f2d49371ff647c89926737a71a62ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Creating volume cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:04 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:04 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 1073741824 Aug 05 16:00:04 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:05 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 1073741824" returned: 0 in 0.518s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:05 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:00:05 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:05 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3579838-3800-485b-8362-c81f5c5de9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca435c0-e381-4276-ae57-ff2677678c87', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce12333-9b8b-4f43-993c-e4514b5c104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Volume volume-cca435c0-e381-4276-ae57-ff2677678c87 (cca435c0-e381-4276-ae57-ff2677678c87): created successfully Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce12333-9b8b-4f43-993c-e4514b5c104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Flow 'volume_create_manager' (b34aab28-d1da-44b9-ada8-ce60b36a581b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bbfc15dc-addd-4c4c-be15-520ddd7f02ba tempest-TestStampPattern-1130938315 None] Created volume successfully. Aug 05 16:00:13 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=65,cinder:UPDATE=77,cinder:DELETE=6,cinder:INSERT=16 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:00:13 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=54,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=7 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:00:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-362edba4-6e18-4854-ac04-b1bd7c1f8827 tempest-TestShelveInstance-450959933 None] Terminate volume connection completed successfully. Aug 05 16:00:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-362edba4-6e18-4854-ac04-b1bd7c1f8827 tempest-TestShelveInstance-450959933 None] Deleting attachment 93ebd6ea-324b-438b-9277-f2fde0cd8308. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Acquiring lock "cinder-6e5086c2-f68e-49f8-9a2b-21d619eb7d27-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "cinder-6e5086c2-f68e-49f8-9a2b-21d619eb7d27-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Acquiring lock "cinder-quobyte-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "cinder-quobyte-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72e1860-3459-4246-881c-6830b1df22ee]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:14 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 16:00:14 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:15 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.795s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:15 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 16:00:15 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:16 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 1 in 0.582s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:16 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27 Aug 05 16:00:16 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:16 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" returned: 0 in 0.379s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "cinder-quobyte-6e5086c2-f68e-49f8-9a2b-21d619eb7d27" released by "delete_volume" :: held 1.944s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG cinder.quota [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Created reservations ['2d496fa1-f729-4fb8-a00e-00ec7be4d685', 'a0d41c10-33e3-497c-8beb-87ffde3ed3b4', 'a036eb2e-873c-48b3-8d6c-c2df4c0252cb', 'a8f1d720-6929-4c65-a055-cec31e6deaac'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:16 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:16 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:16 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.348s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:17 devstack cinder-volume[88715]: DEBUG cinder.manager [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Deleted volume successfully. Aug 05 16:00:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [req-491dd0ea-e167-4d92-b244-5d09cf677315 req-80e6bf8d-0648-493d-b560-8ffb570fa3da tempest-TestShelveInstance-450959933 None] Lock "cinder-6e5086c2-f68e-49f8-9a2b-21d619eb7d27-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (5f6a9594-5b5b-4184-a1b0-e48e2b77d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95695358-d3f6-4a91-9d32-28c9bf644d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95695358-d3f6-4a91-9d32-28c9bf644d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1236716762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c039463d-84d8-47d5-86c6-96179f350df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:20Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3f5fe-5ba7-4725-a88a-01c1a59f2027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3f5fe-5ba7-4725-a88a-01c1a59f2027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7dbe6d-6a9e-4de1-a6bd-3d2daf262385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7dbe6d-6a9e-4de1-a6bd-3d2daf262385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c039463d-84d8-47d5-86c6-96179f350df0', 'volume_name': 'volume-c039463d-84d8-47d5-86c6-96179f350df0', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cece4f53-caf7-421e-bfc0-57041f2067b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cece4f53-caf7-421e-bfc0-57041f2067b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0cb049-e7db-49e7-9131-9f79a192087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume c039463d-84d8-47d5-86c6-96179f350df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c039463d-84d8-47d5-86c6-96179f350df0', 'volume_size': 1} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1236716762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c039463d-84d8-47d5-86c6-96179f350df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:20Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Creating volume c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:20 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:20 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 1073741824 Aug 05 16:00:20 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:21 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 1073741824" returned: 0 in 0.558s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:21 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 Aug 05 16:00:21 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:21 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0" returned: 0 in 0.427s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0cb049-e7db-49e7-9131-9f79a192087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c039463d-84d8-47d5-86c6-96179f350df0', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44187a3-2135-4031-88df-ab89426169a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:21 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume volume-c039463d-84d8-47d5-86c6-96179f350df0 (c039463d-84d8-47d5-86c6-96179f350df0): created successfully Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44187a3-2135-4031-88df-ab89426169a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (5f6a9594-5b5b-4184-a1b0-e48e2b77d192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-458fc178-7e39-4d6f-9c04-0141b3329f0d tempest-VolumesSnapshotTestJSON-1556294135 None] Created volume successfully. Aug 05 16:00:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Creating offline snapshot fe66612c-636c-4157-96f4-dcab15a5f664 of volume c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:00:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b584c1-fe01-4606-8954-d93e4fb4575e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:23 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 Aug 05 16:00:23 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:23 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0" returned: 0 in 0.437s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:23 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 1G Aug 05 16:00:23 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:23 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 1G" returned: 0 in 0.389s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c039463d-84d8-47d5-86c6-96179f350df0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:23 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c039463d-84d8-47d5-86c6-96179f350df0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 Aug 05 16:00:23 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:24 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c039463d-84d8-47d5-86c6-96179f350df0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664" returned: 0 in 0.470s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:24 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 is being set with open permissions: ugo+rw Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:24 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 Aug 05 16:00:24 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:24 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664" returned: 0 in 0.300s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:24 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info Aug 05 16:00:24 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:24 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:24 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info is being set with open permissions: ugo+rw Aug 05 16:00:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:24 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info Aug 05 16:00:24 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:25 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.info" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1bf1d7a1-8dbd-4656-b63b-3eceda40d8fd tempest-VolumesSnapshotTestJSON-1556294135 None] Create snapshot completed successfully Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-fe66612c-636c-4157-96f4-dcab15a5f664-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-fe66612c-636c-4157-96f4-dcab15a5f664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-fe66612c-636c-4157-96f4-dcab15a5f664" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-fe66612c-636c-4157-96f4-dcab15a5f664" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Deleting offline snapshot fe66612c-636c-4157-96f4-dcab15a5f664 of volume c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] snapshot_file for this snap is: volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b5893-ae4d-44b1-bbe9-b8f42a0b12cb]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:26 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 Aug 05 16:00:26 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:26 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c039463d-84d8-47d5-86c6-96179f350df0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f6394-7d99-41e9-a6c1-a923394dcec3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:26 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 Aug 05 16:00:26 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:27 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0" returned: 0 in 0.389s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:27 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 Aug 05 16:00:27 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:27 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:27 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664 Aug 05 16:00:27 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:27 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0.fe66612c-636c-4157-96f4-dcab15a5f664" returned: 0 in 0.272s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-fe66612c-636c-4157-96f4-dcab15a5f664" released by "_delete_snapshot" :: held 1.543s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" released by "delete_snapshot" :: held 1.580s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:27 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['dcacb29e-4832-4a5c-aa36-849f4edbf78e', 'c3a3621c-caca-426a-bce9-2ee79d44c08d', 'cd4a8e0d-32f9-4a5f-93de-13a054c8631d', 'a99d9a17-3a9b-42ab-bafb-b470b4549277'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Delete snapshot completed successfully. Aug 05 16:00:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-67c11e6c-f0c2-4a62-8ce9-94a5cdfaf88d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-fe66612c-636c-4157-96f4-dcab15a5f664-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (e5bcfe48-9d3b-471f-9268-1eab3e92fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d8a04-5f18-4277-b928-00f54e912b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d8a04-5f18-4277-b928-00f54e912b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1078107177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e63fce-471b-45fc-acd6-57ec1deb0b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:29Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29130a5-1745-45bb-b04d-0cc2d0ef3d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29130a5-1745-45bb-b04d-0cc2d0ef3d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd7b0bd-394a-45ac-be76-acbf756b8442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd7b0bd-394a-45ac-be76-acbf756b8442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e63fce-471b-45fc-acd6-57ec1deb0b9a', 'volume_name': 'volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1480a5-1640-4990-a5e3-041295f43d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1480a5-1640-4990-a5e3-041295f43d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ea3d34-38f9-44a6-b38f-a2d4711c3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Volume e7e63fce-471b-45fc-acd6-57ec1deb0b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a', 'volume_size': 1} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1078107177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e63fce-471b-45fc-acd6-57ec1deb0b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:29Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Creating volume e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:29 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:29 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a 1073741824 Aug 05 16:00:29 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:29 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a 1073741824" returned: 0 in 0.529s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:29 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:29 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:29 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ea3d34-38f9-44a6-b38f-a2d4711c3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b51060c-7eef-43cf-9b3b-b81f841baa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Volume volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a (e7e63fce-471b-45fc-acd6-57ec1deb0b9a): created successfully Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b51060c-7eef-43cf-9b3b-b81f841baa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (e5bcfe48-9d3b-471f-9268-1eab3e92fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-06c51193-f1cc-45df-82b1-17b55760ac92 tempest-VolumesSnapshotTestJSON-1556294135 None] Created volume successfully. Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Creating offline snapshot 2155b9f7-1437-4434-b7ff-4b854510a9b7 of volume e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8334fd5-f717-4e84-bd4d-a288a795302c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:31 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:31 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:31 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:31 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 1G Aug 05 16:00:31 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:32 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 1G" returned: 0 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:32 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:32 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:32 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:32 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 is being set with open permissions: ugo+rw Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:32 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:32 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:32 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:32 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info Aug 05 16:00:32 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (01266bf5-6f48-49fd-b90f-396c966cbd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513d3006-c71b-4f0f-947b-16018ab5f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513d3006-c71b-4f0f-947b-16018ab5f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985288381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc2f43-f19c-4e03-b4c5-5403d86f1664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:33Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8f107-fc9a-41cb-98ae-13c3ee23f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8f107-fc9a-41cb-98ae-13c3ee23f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f164111a-1b69-4984-b2fd-400f2eec5df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f164111a-1b69-4984-b2fd-400f2eec5df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fc2f43-f19c-4e03-b4c5-5403d86f1664', 'volume_name': 'volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34972a4b-d41e-4c39-851f-3c2375253b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34972a4b-d41e-4c39-851f-3c2375253b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fcfdaa-e213-4c4c-82ad-a17399387f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Volume 95fc2f43-f19c-4e03-b4c5-5403d86f1664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664', 'volume_size': 1} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info" returned: 0 in 0.425s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:33 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info is being set with open permissions: ugo+rw Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:33 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info Aug 05 16:00:33 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:33 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.info" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985288381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fc2f43-f19c-4e03-b4c5-5403d86f1664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:33Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Creating volume 95fc2f43-f19c-4e03-b4c5-5403d86f1664 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:33 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:33 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 1073741824 Aug 05 16:00:33 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a3bef80c-a43b-41b0-8534-fb1c3cf7f3d5 tempest-VolumesSnapshotTestJSON-1556294135 None] Create snapshot completed successfully Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (6e9ab4f5-a667-4020-8fa7-d93cd47b940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ab92f-6f32-4048-8cbf-13e2504ddcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ab92f-6f32-4048-8cbf-13e2504ddcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036856009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b065164-2dd7-482f-bd03-7f35345e5454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:33Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856af24a-c2ed-41a4-a48f-56baa31c2306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856af24a-c2ed-41a4-a48f-56baa31c2306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a150b38-f9dc-45fa-a56c-e210dbdd8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a150b38-f9dc-45fa-a56c-e210dbdd8e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b065164-2dd7-482f-bd03-7f35345e5454', 'volume_name': 'volume-6b065164-2dd7-482f-bd03-7f35345e5454', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f102e1-dddd-47c5-93b9-a2a65bcd4710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f102e1-dddd-47c5-93b9-a2a65bcd4710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970ccd8a-a5b0-405f-a1c1-d6c90e546bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Volume 6b065164-2dd7-482f-bd03-7f35345e5454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b065164-2dd7-482f-bd03-7f35345e5454', 'volume_size': 1} Aug 05 16:00:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (837f5d03-02d8-4e27-8845-425a4a9f3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99338930-74bc-4cc0-844e-87ee05807fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99338930-74bc-4cc0-844e-87ee05807fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799910350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc17b4-bc35-41d2-b30d-daa4c702c4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:34Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99c0126-cd74-4244-aecc-6e3ba5f9b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99c0126-cd74-4244-aecc-6e3ba5f9b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4059b471-b572-49f7-922c-1fcd4886308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4059b471-b572-49f7-922c-1fcd4886308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfc17b4-bc35-41d2-b30d-daa4c702c4ea', 'volume_name': 'volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bb9c4e-8836-419d-b7b4-b3d370bd17b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bb9c4e-8836-419d-b7b4-b3d370bd17b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf943a3-f7b0-4d8e-a330-d52b00f637a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Volume 8dfc17b4-bc35-41d2-b30d-daa4c702c4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea', 'volume_size': 1} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:34 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 1073741824" returned: 0 in 0.680s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:34 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 Aug 05 16:00:34 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (8d14bf8c-ce79-48b3-9040-39b3666917c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42219963-8aaf-4c4b-92f2-5a921f023da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2036856009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b065164-2dd7-482f-bd03-7f35345e5454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:33Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Creating volume 6b065164-2dd7-482f-bd03-7f35345e5454 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:34 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42219963-8aaf-4c4b-92f2-5a921f023da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-40428198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a4db80-3b4e-41d6-b57e-807ddf4a7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:34Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 1073741824 Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d2cca7-15dc-4aad-8625-83ab17dc5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d2cca7-15dc-4aad-8625-83ab17dc5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d395dda3-f70f-41ec-b706-0c1b2fa0124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d395dda3-f70f-41ec-b706-0c1b2fa0124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a4db80-3b4e-41d6-b57e-807ddf4a7330', 'volume_name': 'volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab11cc2-b8af-4c7c-9e60-8c1370b5a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab11cc2-b8af-4c7c-9e60-8c1370b5a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37edb18-5eb3-4d0d-9747-36e24679957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Volume 62a4db80-3b4e-41d6-b57e-807ddf4a7330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330', 'volume_size': 1} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31fcfdaa-e213-4c4c-82ad-a17399387f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf98bb7a-a73f-4e38-8ca7-b93e44ff7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:34 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Volume volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 (95fc2f43-f19c-4e03-b4c5-5403d86f1664): created successfully Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf98bb7a-a73f-4e38-8ca7-b93e44ff7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:34 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (01266bf5-6f48-49fd-b90f-396c966cbd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:34 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-89e47463-de96-4895-a358-cf71a01aa60c tempest-CreateVolumesFromImageTest-1079462784 None] Created volume successfully. Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (c71ddfa8-57b0-49ad-a514-ff3ffe289589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8c187-26a5-4c02-9471-80c9baa56e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d8c187-26a5-4c02-9471-80c9baa56e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188631772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e1be11-307a-4079-a52d-423183b0ee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:35Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec0d960-c10d-420c-8738-79679b9ccbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec0d960-c10d-420c-8738-79679b9ccbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37d4489-8ea5-4927-9b14-e27a22b39f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37d4489-8ea5-4927-9b14-e27a22b39f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e1be11-307a-4079-a52d-423183b0ee32', 'volume_name': 'volume-d7e1be11-307a-4079-a52d-423183b0ee32', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4378a3-8874-415f-8da2-6bee34029b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4378a3-8874-415f-8da2-6bee34029b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedf4d04-0836-427e-a200-7c1e72beefea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Volume d7e1be11-307a-4079-a52d-423183b0ee32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e1be11-307a-4079-a52d-423183b0ee32', 'volume_size': 1} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:35 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 1073741824" returned: 0 in 0.640s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:35 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 Aug 05 16:00:35 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (abc2b09a-3347-4681-aa4b-78244e85d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deca760b-77b5-4480-9930-5a42d169fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deca760b-77b5-4480-9930-5a42d169fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825492124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02969a4c-1596-4403-9502-a399c6794fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2155b9f7-1437-4434-b7ff-4b854510a9b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:35Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af1c3d2-b330-4661-8b4c-7810a56e7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af1c3d2-b330-4661-8b4c-7810a56e7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fec997-a18f-46a2-b8a8-6a489fee0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fec997-a18f-46a2-b8a8-6a489fee0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02969a4c-1596-4403-9502-a399c6794fcf', 'volume_name': 'volume-02969a4c-1596-4403-9502-a399c6794fcf', 'volume_size': 2, 'snapshot_id': '2155b9f7-1437-4434-b7ff-4b854510a9b7'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c20e49-578a-4f75-b872-2bb122adc65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c20e49-578a-4f75-b872-2bb122adc65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5211ac26-882b-4f2b-8fbf-f725fd83611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume 02969a4c-1596-4403-9502-a399c6794fcf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02969a4c-1596-4403-9502-a399c6794fcf', 'volume_size': 2, 'snapshot_id': '2155b9f7-1437-4434-b7ff-4b854510a9b7'} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:35 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454" returned: 0 in 0.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799910350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc17b4-bc35-41d2-b30d-daa4c702c4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:34Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Creating volume 8dfc17b4-bc35-41d2-b30d-daa4c702c4ea {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:35 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:35 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea 1073741824 Aug 05 16:00:35 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970ccd8a-a5b0-405f-a1c1-d6c90e546bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b065164-2dd7-482f-bd03-7f35345e5454', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43d302a-8854-4cfc-a7c9-93839548e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Volume volume-6b065164-2dd7-482f-bd03-7f35345e5454 (6b065164-2dd7-482f-bd03-7f35345e5454): created successfully Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43d302a-8854-4cfc-a7c9-93839548e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (6e9ab4f5-a667-4020-8fa7-d93cd47b940b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-21754e71-05e7-4f66-8fd3-a7edf5817f12 tempest-CreateVolumesFromImageTest-1079462784 None] Created volume successfully. Aug 05 16:00:36 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea 1073741824" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:36 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea Aug 05 16:00:36 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:36 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-40428198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a4db80-3b4e-41d6-b57e-807ddf4a7330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:34Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Creating volume 62a4db80-3b4e-41d6-b57e-807ddf4a7330 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:36 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf943a3-f7b0-4d8e-a330-d52b00f637a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:36 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 1073741824 Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ff85ba-947c-46f9-a5ce-3dab8ed89008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:36 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:36 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Volume volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea (8dfc17b4-bc35-41d2-b30d-daa4c702c4ea): created successfully Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ff85ba-947c-46f9-a5ce-3dab8ed89008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (837f5d03-02d8-4e27-8845-425a4a9f3ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:36 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-97aecbd8-8730-4291-8bdf-095475e3c829 tempest-CreateVolumesFromImageTest-1079462784 None] Created volume successfully. Aug 05 16:00:36 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 1073741824" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:36 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 Aug 05 16:00:36 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:37 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330" returned: 0 in 0.244s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-188631772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e1be11-307a-4079-a52d-423183b0ee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba9ff7cdd259456a98adb2169e079d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:35Z,use_quota=True,user_id='b0cc09e87eaf47e9ac12997bb13cd755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Creating volume d7e1be11-307a-4079-a52d-423183b0ee32 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:37 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37edb18-5eb3-4d0d-9747-36e24679957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:37 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 1073741824 Aug 05 16:00:37 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aad3dd-03e9-4100-bb43-60d8a7354116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:37 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Volume volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 (62a4db80-3b4e-41d6-b57e-807ddf4a7330): created successfully Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80aad3dd-03e9-4100-bb43-60d8a7354116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (8d14bf8c-ce79-48b3-9040-39b3666917c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d87d7e32-36d4-43df-b7b9-2523cd89b673 tempest-CreateVolumesFromImageTest-1079462784 None] Created volume successfully. Aug 05 16:00:37 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 1073741824" returned: 0 in 0.421s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:37 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 Aug 05 16:00:37 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:37 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.265s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7-02969a4c-1596-4403-9502-a399c6794fcf" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedf4d04-0836-427e-a200-7c1e72beefea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e1be11-307a-4079-a52d-423183b0ee32', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017849a1-5d9a-498e-a24a-61316a61c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7-02969a4c-1596-4403-9502-a399c6794fcf" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Creating volume 02969a4c-1596-4403-9502-a399c6794fcf from snapshot 2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:37 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Volume volume-d7e1be11-307a-4079-a52d-423183b0ee32 (d7e1be11-307a-4079-a52d-423183b0ee32): created successfully Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017849a1-5d9a-498e-a24a-61316a61c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Flow 'volume_create_manager' (c71ddfa8-57b0-49ad-a514-ff3ffe289589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] snapshot: 2155b9f7-1437-4434-b7ff-4b854510a9b7, volume: 02969a4c-1596-4403-9502-a399c6794fcf, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:00:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-91192cc3-833f-4197-b842-72d755d57d76 tempest-CreateVolumesFromImageTest-1079462784 None] Created volume successfully. Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c850b-e922-4adb-be66-eab2f4e84ab1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:37 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:37 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:38 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6876825c-627f-42c2-a004-606ff18d012c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-d7e1be11-307a-4079-a52d-423183b0ee32-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:38 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:38 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-d7e1be11-307a-4079-a52d-423183b0ee32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-quobyte-d7e1be11-307a-4079-a52d-423183b0ee32" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-d7e1be11-307a-4079-a52d-423183b0ee32" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa519e-9ab6-4a31-9f84-5eede7bde392]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:38 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 Aug 05 16:00:38 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:38 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.403s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:38 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf Aug 05 16:00:38 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:38 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32" returned: 0 in 0.379s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:38 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32 Aug 05 16:00:38 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:39 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d7e1be11-307a-4079-a52d-423183b0ee32" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-d7e1be11-307a-4079-a52d-423183b0ee32" released by "delete_volume" :: held 0.718s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Created reservations ['d09b6342-7185-460b-8fcd-de7791ba7125', '4da15fcc-7c3f-4921-9aca-a3398e87ec7a', '6e760321-08be-4da5-bcb5-2684a88ecc4f', 'c48e4afe-4f28-448c-8bde-61367ce9f10c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:39 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:39 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-62a4db80-3b4e-41d6-b57e-807ddf4a7330-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-62a4db80-3b4e-41d6-b57e-807ddf4a7330-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-quobyte-62a4db80-3b4e-41d6-b57e-807ddf4a7330" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-62a4db80-3b4e-41d6-b57e-807ddf4a7330" acquired by "delete_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f0980-39d5-43ef-b39d-99819116d3b0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:40 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.537s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Deleted volume successfully. Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ac45b50-9f35-4184-9996-0ef61b3c22f4 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-d7e1be11-307a-4079-a52d-423183b0ee32-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:40 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 Aug 05 16:00:40 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:40 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330" returned: 0 in 0.776s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:40 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330 Aug 05 16:00:40 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:41 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-62a4db80-3b4e-41d6-b57e-807ddf4a7330" returned: 0 in 0.561s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-62a4db80-3b4e-41d6-b57e-807ddf4a7330" released by "delete_volume" :: held 1.424s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Created reservations ['25cc8f9d-64f4-454f-bd0a-391ec65dac4d', '822a91df-2f3b-47df-80eb-e7bbb4fc9852', 'a1d9b1e2-29bf-4fb0-bcec-fc3de7391111', '78472277-c8f7-482d-8411-db9d011ec229'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:41 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:41 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:42 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.900s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:42 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Deleted volume successfully. Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-quobyte-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f3887f2a-d8ae-40f7-abbf-8e1ae74f8512 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-62a4db80-3b4e-41d6-b57e-807ddf4a7330-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" acquired by "delete_volume" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ca816-18ee-4ca8-81f4-120c2c3cef7f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:42 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea Aug 05 16:00:42 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:43 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" returned: 0 in 0.908s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:43 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea Aug 05 16:00:43 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:43 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf" returned: 0 in 5.031s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4ddb1a-6be8-4ba7-ad4e-9f5b3b0cf5f1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:43 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:43 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:43 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" returned: 0 in 0.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea" released by "delete_volume" :: held 1.251s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Created reservations ['62b564f8-cac6-4aa6-92ec-eda4349c1607', '87284d35-0f8b-4de8-8a8d-a8c7bbdd4334', 'a095c211-7b0f-4335-9825-05b8e8900d0e', 'dee19c7e-b998-43dc-94fb-ca780dac1c7e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:44 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:44 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:44 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.586s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:00:44 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Converted 1024.00 MB image at 203.48 MB/s Aug 05 16:00:44 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf is being set with open permissions: ugo+rw Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:44 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Deleted volume successfully. Aug 05 16:00:44 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf Aug 05 16:00:44 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-76a5968d-61f8-4ba3-831b-c10823a0bb84 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-8dfc17b4-bc35-41d2-b30d-daa4c702c4ea-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:44 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" released by "_copy_volume_from_snapshot" :: held 6.717s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7-02969a4c-1596-4403-9502-a399c6794fcf" released by "_create_volume_from_snapshot" :: held 6.760s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.797s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.961s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0fa1dc-21f6-4169-a4be-49bf68f006f3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5211ac26-882b-4f2b-8fbf-f725fd83611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02969a4c-1596-4403-9502-a399c6794fcf', 'volume_size': 2, 'snapshot_id': '2155b9f7-1437-4434-b7ff-4b854510a9b7'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e53be3e-628a-4b8a-ad92-656350b4cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:44 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Volume volume-02969a4c-1596-4403-9502-a399c6794fcf (02969a4c-1596-4403-9502-a399c6794fcf): created successfully Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e53be3e-628a-4b8a-ad92-656350b4cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (abc2b09a-3347-4681-aa4b-78244e85d328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7f19ccc0-e4e4-4ace-9bd4-415c5dd3be9d tempest-VolumesSnapshotTestJSON-1556294135 None] Created volume successfully. Aug 05 16:00:44 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:00:44 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-6b065164-2dd7-482f-bd03-7f35345e5454-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-6b065164-2dd7-482f-bd03-7f35345e5454-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-quobyte-6b065164-2dd7-482f-bd03-7f35345e5454" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-6b065164-2dd7-482f-bd03-7f35345e5454" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72cd2c-5378-4d21-953a-2c7ed687d167]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:44 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.392s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.411s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:44 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-cca435c0-e381-4276-ae57-ff2677678c87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f061acc-6b51-404d-b2c5-27361c326e60', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:00:45 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 Aug 05 16:00:45 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-54461307-4171-425c-b60b-cbfbc9c07fc7 req-3b0938b0-9bca-4261-a5fe-29240bf91e38 tempest-TestStampPattern-1130938315 None] attachment_update completed successfully. Aug 05 16:00:45 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454" returned: 0 in 0.404s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-02969a4c-1596-4403-9502-a399c6794fcf-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454 Aug 05 16:00:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-02969a4c-1596-4403-9502-a399c6794fcf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e42796-b6ea-49e6-9d71-763be051f1de]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:45 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf Aug 05 16:00:45 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:45 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6b065164-2dd7-482f-bd03-7f35345e5454" returned: 0 in 0.324s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-6b065164-2dd7-482f-bd03-7f35345e5454" released by "delete_volume" :: held 0.777s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Created reservations ['995f20cc-d95f-4343-adcb-da6ee910557a', '57b66f17-ddfa-4969-9f37-bca05832eb1c', '0aa51621-c642-42c8-b348-4a3ea89cdf6e', '2b7053d3-3086-4249-b7ac-a4cdab1b3072'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:45 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:45 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:45 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf" returned: 0 in 0.473s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:45 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf Aug 05 16:00:45 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-95fc2f43-f19c-4e03-b4c5-5403d86f1664-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-95fc2f43-f19c-4e03-b4c5-5403d86f1664-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "cinder-quobyte-95fc2f43-f19c-4e03-b4c5-5403d86f1664" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:46 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.320s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-95fc2f43-f19c-4e03-b4c5-5403d86f1664" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Deleted volume successfully. Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af614a-66f4-4ccf-a4e3-da988edbb33a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-11fd0df3-fbec-43b7-a637-d48e1c2ac40b tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-6b065164-2dd7-482f-bd03-7f35345e5454-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:46 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-02969a4c-1596-4403-9502-a399c6794fcf" returned: 0 in 0.340s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-02969a4c-1596-4403-9502-a399c6794fcf" released by "delete_volume" :: held 0.861s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:46 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 Aug 05 16:00:46 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['adc410c7-6f47-40c2-b4cd-5707c1675155', 'fc29ed23-cff1-4bb5-995b-18df7d1a3ae7', '47759890-8edf-4012-9263-483f15ca465d', 'eaac6fc7-de11-4675-b749-775b9cbb0010'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:46 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:46 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-2155b9f7-1437-4434-b7ff-4b854510a9b7-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-2155b9f7-1437-4434-b7ff-4b854510a9b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:46 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664" returned: 0 in 0.425s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:46 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664 Aug 05 16:00:46 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Deleting offline snapshot 2155b9f7-1437-4434-b7ff-4b854510a9b7 of volume e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] snapshot_file for this snap is: volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2411f-ca17-4067-89fc-28d47239dcc5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:46 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.300s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Deleted volume successfully. Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2cfca071-4e99-4601-b6f6-3ac7f67f3165 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-02969a4c-1596-4403-9502-a399c6794fcf-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:46 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:46 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:46 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-95fc2f43-f19c-4e03-b4c5-5403d86f1664" returned: 0 in 0.302s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-quobyte-95fc2f43-f19c-4e03-b4c5-5403d86f1664" released by "delete_volume" :: held 0.781s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:46 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Created reservations ['d8c49f6d-bd09-4182-ba53-814e6d482b64', '00b3955b-4900-4ba2-9a2f-be7e3f91ee6e', '0cd8184d-c05f-42ee-af6a-697b69f0b14a', '36eef58b-5eac-4474-b936-c844ba3afe3c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:47 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:00:47 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:47 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ee772-be34-4f2d-b47a-fe2dbe1f6bc3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:47 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:47 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:47 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Deleted volume successfully. Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bad95c69-51c7-4c9f-b710-3b38ac4b4b60 tempest-CreateVolumesFromImageTest-1079462784 None] Lock "cinder-95fc2f43-f19c-4e03-b4c5-5403d86f1664-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:47 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.465s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:47 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:47 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:48 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.462s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:48 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7 Aug 05 16:00:48 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:48 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a.2155b9f7-1437-4434-b7ff-4b854510a9b7" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2155b9f7-1437-4434-b7ff-4b854510a9b7" released by "_delete_snapshot" :: held 1.735s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" released by "delete_snapshot" :: held 1.766s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['93472954-f7b1-4d81-98c7-3a10fbb2adea', '64a378f1-9e13-4792-a539-d2b20209eff9', '78359e7e-a8dc-4622-bb61-d62b9ac7abcf', '8a59729b-9e93-4c58-a2c7-5f61388c93e4'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:48 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Delete snapshot completed successfully. Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-05a84c32-e6af-41ef-9bef-a116c6ec9a32 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-2155b9f7-1437-4434-b7ff-4b854510a9b7-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-e7e63fce-471b-45fc-acd6-57ec1deb0b9a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-e7e63fce-471b-45fc-acd6-57ec1deb0b9a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a55ff-20f4-4e3f-9b21-2e9412d4eed9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:49 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:49 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:49 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.398s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:49 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a Aug 05 16:00:49 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:49 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" returned: 0 in 0.272s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-e7e63fce-471b-45fc-acd6-57ec1deb0b9a" released by "delete_volume" :: held 0.745s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['b2fd8c66-62ac-4bda-845d-84e42102f429', '7df2aa86-39cd-4c69-b97b-703336c86870', '8de1d083-4f0b-4f32-851f-4a115497900f', 'fc7ceb84-d24b-43f7-acce-30140f08e0bc'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:49 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:00:49 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:50 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:00:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Deleted volume successfully. Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-48bd9c81-3dc4-48d9-b5d5-1acf01131e6d tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-e7e63fce-471b-45fc-acd6-57ec1deb0b9a-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:00:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-0b58d9dd-3ab4-4502-8ec7-950e2e594ef9 req-07238baf-b489-4edd-a45b-59a749355728 tempest-TestStampPattern-1130938315 None] Terminate volume connection completed successfully. Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-0b58d9dd-3ab4-4502-8ec7-950e2e594ef9 req-07238baf-b489-4edd-a45b-59a749355728 tempest-TestStampPattern-1130938315 None] Deleting attachment 0f061acc-6b51-404d-b2c5-27361c326e60. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Flow 'volume_create_manager' (0e9d5f5b-abc5-4e78-8c5a-9f9dcb5b8153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd480a41-8b12-42cd-a9a0-a6246f56abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd480a41-8b12-42cd-a9a0-a6246f56abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316fd49f-45c2-49ee-a314-eddd6bd6703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188d9b9fea714ad4919e18a409a3f43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:51Z,use_quota=True,user_id='b106576fd32c41ba81ba2e72d0290b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d70fdb3-f3d1-4fc4-910d-0c18bec5684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d70fdb3-f3d1-4fc4-910d-0c18bec5684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7246d216-b584-400c-abed-dc4bb3042555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7246d216-b584-400c-abed-dc4bb3042555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316fd49f-45c2-49ee-a314-eddd6bd6703a', 'volume_name': 'volume-316fd49f-45c2-49ee-a314-eddd6bd6703a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d91f8-cf58-4b2f-892f-97b1771fc39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d91f8-cf58-4b2f-892f-97b1771fc39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc15cf7-93f1-4ca1-b561-78ca7390dbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Volume 316fd49f-45c2-49ee-a314-eddd6bd6703a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316fd49f-45c2-49ee-a314-eddd6bd6703a', 'volume_size': 1} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316fd49f-45c2-49ee-a314-eddd6bd6703a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188d9b9fea714ad4919e18a409a3f43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:51Z,use_quota=True,user_id='b106576fd32c41ba81ba2e72d0290b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Creating volume 316fd49f-45c2-49ee-a314-eddd6bd6703a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:50 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:50 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a 1073741824 Aug 05 16:00:50 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (5b04b815-c036-4be5-b4f9-dbde7a54ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b4556-823d-4c5f-b82f-30b463b41fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55b4556-823d-4c5f-b82f-30b463b41fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-12573283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1959cd-2c54-45d7-8ce3-a4e1973a0825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:51Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7954d4d0-34a3-4c42-8508-a3144128432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7954d4d0-34a3-4c42-8508-a3144128432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97899507-1eff-472c-91ff-3375b6973d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97899507-1eff-472c-91ff-3375b6973d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1959cd-2c54-45d7-8ce3-a4e1973a0825', 'volume_name': 'volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e192ce9-1889-4345-bd33-89492ff1c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e192ce9-1889-4345-bd33-89492ff1c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735baaac-d59c-43f8-a824-4bb1a12f84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Volume 2d1959cd-2c54-45d7-8ce3-a4e1973a0825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825', 'volume_size': 1} Aug 05 16:00:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:51 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a 1073741824" returned: 0 in 0.439s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:51 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a Aug 05 16:00:51 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:51 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-12573283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1959cd-2c54-45d7-8ce3-a4e1973a0825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:51Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Creating volume 2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:51 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:51 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 1073741824 Aug 05 16:00:51 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc15cf7-93f1-4ca1-b561-78ca7390dbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316fd49f-45c2-49ee-a314-eddd6bd6703a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17404a90-bf98-45fa-b71f-99974a209e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:51 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Volume volume-316fd49f-45c2-49ee-a314-eddd6bd6703a (316fd49f-45c2-49ee-a314-eddd6bd6703a): created successfully Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17404a90-bf98-45fa-b71f-99974a209e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Flow 'volume_create_manager' (0e9d5f5b-abc5-4e78-8c5a-9f9dcb5b8153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ee879599-642f-451f-8720-8a49f3e2cf1c tempest-CinderUnicodeTest-664648776 None] Created volume successfully. Aug 05 16:00:51 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 1073741824" returned: 0 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:52 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:00:52 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:52 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.947s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735baaac-d59c-43f8-a824-4bb1a12f84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4d488-af35-4305-8512-7ecdbe61ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Creating offline snapshot 2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 of volume cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:00:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Volume volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 (2d1959cd-2c54-45d7-8ce3-a4e1973a0825): created successfully Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4d488-af35-4305-8512-7ecdbe61ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (5b04b815-c036-4be5-b4f9-dbde7a54ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf089a1-02a6-482a-8b15-c691f5d65f0a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-21d0cafb-0d59-425c-97dd-44f3ebe1e25f tempest-VolumesSnapshotTestJSON-1556294135 None] Created volume successfully. Aug 05 16:00:52 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:00:52 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:52 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:52 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 1G Aug 05 16:00:52 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:53 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 1G" returned: 0 in 0.497s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca435c0-e381-4276-ae57-ff2677678c87 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:53 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca435c0-e381-4276-ae57-ff2677678c87 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:00:53 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Flow 'volume_create_manager' (00314de2-c6c2-4b9b-b0b0-b55288c7c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c69fd-608b-41b9-a4a8-7016d307af6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c69fd-608b-41b9-a4a8-7016d307af6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-698775787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e282638-1f61-49cd-82b0-e2f3651adf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188d9b9fea714ad4919e18a409a3f43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:53Z,use_quota=True,user_id='b106576fd32c41ba81ba2e72d0290b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe257e3-30c9-4288-99cd-ee0ad1e77ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe257e3-30c9-4288-99cd-ee0ad1e77ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc568776-7893-4f40-92c2-3474f6c077b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc568776-7893-4f40-92c2-3474f6c077b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e282638-1f61-49cd-82b0-e2f3651adf1f', 'volume_name': 'volume-8e282638-1f61-49cd-82b0-e2f3651adf1f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffc5e05-2c50-47e2-a1c9-dfdfcfc73a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffc5e05-2c50-47e2-a1c9-dfdfcfc73a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d196c06-7047-465e-9cb9-a2128543fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Volume 8e282638-1f61-49cd-82b0-e2f3651adf1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e282638-1f61-49cd-82b0-e2f3651adf1f', 'volume_size': 1} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:53 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cca435c0-e381-4276-ae57-ff2677678c87 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:53 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 is being set with open permissions: ugo+rw Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:53 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:00:53 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:53 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:53 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info Aug 05 16:00:53 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:54 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:54 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info is being set with open permissions: ugo+rw Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:54 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info Aug 05 16:00:54 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:54 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.info" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.415s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Creating offline snapshot d9412100-aaed-4116-a9d0-d6450c50bbb5 of volume 2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:00:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cc2c2e52-3a50-4b17-a259-caf08c3a9b48 tempest-TestStampPattern-1130938315 None] Create snapshot completed successfully Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e2535-4644-4d61-a71a-2f37764c55f0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:54 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:00:54 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:54 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.393s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:54 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 1G Aug 05 16:00:54 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:55 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 1G" returned: 0 in 0.391s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:55 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:00:55 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:55 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 0.325s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:55 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 is being set with open permissions: ugo+rw Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:55 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:00:55 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:55 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:55 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info Aug 05 16:00:55 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:56 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:56 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info is being set with open permissions: ugo+rw Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:56 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info Aug 05 16:00:56 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:56 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.info" returned: 0 in 0.273s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-698775787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e282638-1f61-49cd-82b0-e2f3651adf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188d9b9fea714ad4919e18a409a3f43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:53Z,use_quota=True,user_id='b106576fd32c41ba81ba2e72d0290b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Creating volume 8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:56 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f 1073741824 Aug 05 16:00:56 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-376359e7-fc6b-41c0-bcd6-cc9fd5a7d081 tempest-VolumesSnapshotTestJSON-1556294135 None] Create snapshot completed successfully Aug 05 16:00:56 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f 1073741824" returned: 0 in 0.478s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:56 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f Aug 05 16:00:56 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:57 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d196c06-7047-465e-9cb9-a2128543fe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e282638-1f61-49cd-82b0-e2f3651adf1f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c7208e-b4de-434f-828a-169e73de0a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Volume volume-8e282638-1f61-49cd-82b0-e2f3651adf1f (8e282638-1f61-49cd-82b0-e2f3651adf1f): created successfully Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c7208e-b4de-434f-828a-169e73de0a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Flow 'volume_create_manager' (00314de2-c6c2-4b9b-b0b0-b55288c7c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4896441a-a1b9-4289-8c5a-12a03815c3b8 tempest-CinderUnicodeTest-664648776 None] Created volume successfully. Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (562e87c0-62ef-4d9b-8b6e-0e65a597a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b663e13-41e0-4e33-9750-bfa5a8b6d60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b663e13-41e0-4e33-9750-bfa5a8b6d60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1137330040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74a23c0-70a6-4067-83bc-03164ee5437b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4402b114a9984be9a3664ee3e5d424c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9412100-aaed-4116-a9d0-d6450c50bbb5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:00:58Z,use_quota=True,user_id='e036be7676054d26ae315f23621a0bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4816dc3-51c7-4e0c-8c16-e3700cde3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4816dc3-51c7-4e0c-8c16-e3700cde3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cb8ded-9707-4b25-ba2a-a0b3c31244b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cb8ded-9707-4b25-ba2a-a0b3c31244b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f74a23c0-70a6-4067-83bc-03164ee5437b', 'volume_name': 'volume-f74a23c0-70a6-4067-83bc-03164ee5437b', 'volume_size': 1, 'snapshot_id': 'd9412100-aaed-4116-a9d0-d6450c50bbb5'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd670681-007b-47c6-a66d-43ab6dadf823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd670681-007b-47c6-a66d-43ab6dadf823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5784a-df33-4fb2-8ae3-a1fed577192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:00:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Volume f74a23c0-70a6-4067-83bc-03164ee5437b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f74a23c0-70a6-4067-83bc-03164ee5437b', 'volume_size': 1, 'snapshot_id': 'd9412100-aaed-4116-a9d0-d6450c50bbb5'} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Creating offline snapshot bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 of volume 8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c940ec-b88f-405d-a11d-96592d900683]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:57 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f Aug 05 16:00:57 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:58 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f" returned: 0 in 0.357s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:58 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 1G Aug 05 16:00:58 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:58 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 1G" returned: 0 in 0.452s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e282638-1f61-49cd-82b0-e2f3651adf1f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:58 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e282638-1f61-49cd-82b0-e2f3651adf1f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 Aug 05 16:00:58 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:58 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e282638-1f61-49cd-82b0-e2f3651adf1f -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:58 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 is being set with open permissions: ugo+rw Aug 05 16:00:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:58 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 Aug 05 16:00:58 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:59 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:59 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info Aug 05 16:00:59 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:59 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info" returned: 0 in 0.273s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:59 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info is being set with open permissions: ugo+rw Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:00:59 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info Aug 05 16:00:59 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:00:59 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.info" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.977s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5-f74a23c0-70a6-4067-83bc-03164ee5437b" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5-f74a23c0-70a6-4067-83bc-03164ee5437b" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Creating volume f74a23c0-70a6-4067-83bc-03164ee5437b from snapshot d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:00:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bd086687-b46c-484e-9f39-a0d785e3462c tempest-CinderUnicodeTest-664648776 None] Create snapshot completed successfully Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] snapshot: d9412100-aaed-4116-a9d0-d6450c50bbb5, volume: f74a23c0-70a6-4067-83bc-03164ee5437b, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb666e-82b9-4df6-81ab-16817a669ac6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:00:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:00 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:01:00 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:00 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 0.366s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ea5417-38d2-49b8-9360-58b0a2470a8c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:00 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:01:00 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:00 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.416s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:00 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b Aug 05 16:01:00 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-quobyte-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Deleting offline snapshot bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 of volume 8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] snapshot_file for this snap is: volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b17de3-77a3-4f30-90f1-ccd8e9f6e0cf]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:01 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 Aug 05 16:01:01 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:02 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" returned: 0 in 1.080s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e282638-1f61-49cd-82b0-e2f3651adf1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb1144-a58c-4e77-a4f5-7cbfe5b2dd87]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:02 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f Aug 05 16:01:02 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:03 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f" returned: 0 in 0.801s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:03 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 Aug 05 16:01:03 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:03 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:03 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:03 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" returned: 0 in 0.892s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:04 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210 Aug 05 16:01:04 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:01:04 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Flow 'volume_create_manager' (68d46ad4-0a5c-46ad-a15d-c3e1ecfa136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da7c06d-a903-4141-b2c3-4d2f2e4b578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da7c06d-a903-4141-b2c3-4d2f2e4b578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1724006479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a854a8-d790-4a3d-91a4-276abf7b44d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd3e00fd5bc49a19c47a3cde3331025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e0b360e-06d7-4c75-9de1-d6c15d9f03e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:04Z,use_quota=True,user_id='4f2d49371ff647c89926737a71a62ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e26ef2-0701-47b1-b74d-2d26add37752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e26ef2-0701-47b1-b74d-2d26add37752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8370d4b1-8d4b-4c5c-907e-b5860d5a5063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8370d4b1-8d4b-4c5c-907e-b5860d5a5063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5a854a8-d790-4a3d-91a4-276abf7b44d0', 'volume_name': 'volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0', 'volume_size': 1, 'snapshot_id': '2e0b360e-06d7-4c75-9de1-d6c15d9f03e0'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d580513-37ef-44f6-bcc0-f2604c9046fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d580513-37ef-44f6-bcc0-f2604c9046fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144f69c3-5bf0-4d5b-9e68-b9c611efc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Volume b5a854a8-d790-4a3d-91a4-276abf7b44d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0', 'volume_size': 1, 'snapshot_id': '2e0b360e-06d7-4c75-9de1-d6c15d9f03e0'} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:04 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f.bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" returned: 0 in 0.619s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210" released by "_delete_snapshot" :: held 3.605s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" released by "delete_snapshot" :: held 3.645s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Created reservations ['aa99d383-4902-478a-8293-2aa45dc6e615', 'ff57c820-d992-4fe8-8cc3-02344884fb0c', '47512519-ef9c-443b-999f-0b770cb32cc1', '7420fb4d-3531-4877-be83-7136422f2ba1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Delete snapshot completed successfully. Aug 05 16:01:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c2ebca87-4639-4b5f-aa8d-8228b02100c8 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-bde3f90d-9a32-485c-bf2f-c1cdc2b7e210-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-8e282638-1f61-49cd-82b0-e2f3651adf1f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-8e282638-1f61-49cd-82b0-e2f3651adf1f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" acquired by "delete_volume" :: waited 0.052s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed26dc05-b29d-49f6-b149-fe3def1eaad6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:06 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b" returned: 0 in 5.406s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa820030-87ff-4176-ab05-af27c6bd9263]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:06 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f Aug 05 16:01:06 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:06 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:01:06 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:06 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f" returned: 0 in 0.600s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:06 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f Aug 05 16:01:06 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:06 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8e282638-1f61-49cd-82b0-e2f3651adf1f" returned: 0 in 0.265s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:06 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.644s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:01:06 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Converted 1024.00 MB image at 189.37 MB/s Aug 05 16:01:06 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b is being set with open permissions: ugo+rw Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-8e282638-1f61-49cd-82b0-e2f3651adf1f" released by "delete_volume" :: held 1.031s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:06 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b Aug 05 16:01:06 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Created reservations ['4bd87789-05c6-40c5-a32b-3165c5c9af19', '680be90d-83d4-40ae-bdd3-c3f94b0507a5', 'bb3112c4-acbc-44cb-89a2-ce0382236478', '72ff3acc-1aea-4d1a-8078-cfacf5b3beab'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:07 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:07 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:07 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b" returned: 0 in 0.309s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" released by "_copy_volume_from_snapshot" :: held 7.236s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5-f74a23c0-70a6-4067-83bc-03164ee5437b" released by "_create_volume_from_snapshot" :: held 7.288s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.325s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.677s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-b5a854a8-d790-4a3d-91a4-276abf7b44d0" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-b5a854a8-d790-4a3d-91a4-276abf7b44d0" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Creating volume b5a854a8-d790-4a3d-91a4-276abf7b44d0 from snapshot 2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a5784a-df33-4fb2-8ae3-a1fed577192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74a23c0-70a6-4067-83bc-03164ee5437b', 'volume_size': 1, 'snapshot_id': 'd9412100-aaed-4116-a9d0-d6450c50bbb5'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13af058-ad55-44ac-931a-31b18ad0a2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] snapshot: 2e0b360e-06d7-4c75-9de1-d6c15d9f03e0, volume: b5a854a8-d790-4a3d-91a4-276abf7b44d0, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:01:07 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Volume volume-f74a23c0-70a6-4067-83bc-03164ee5437b (f74a23c0-70a6-4067-83bc-03164ee5437b): created successfully Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13af058-ad55-44ac-931a-31b18ad0a2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Flow 'volume_create_manager' (562e87c0-62ef-4d9b-8b6e-0e65a597a538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:07 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6f621-7224-4f18-9389-ecf0d31114ea]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Deleted volume successfully. Aug 05 16:01:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-88aae448-1906-4349-a912-d2f74a10e0ce tempest-VolumesSnapshotTestJSON-1556294135 None] Created volume successfully. Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-49d10c4d-c589-4604-a07a-d25bc8e80e31 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-8e282638-1f61-49cd-82b0-e2f3651adf1f-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:07 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:01:07 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:07 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.446s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cca435c0-e381-4276-ae57-ff2677678c87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4bdae5-5018-45cf-bfc0-85038a2d96e1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-f74a23c0-70a6-4067-83bc-03164ee5437b-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-f74a23c0-70a6-4067-83bc-03164ee5437b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e382e4c7-5ee2-4573-81bc-abee54e226d7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:07 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:01:07 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-316fd49f-45c2-49ee-a314-eddd6bd6703a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-316fd49f-45c2-49ee-a314-eddd6bd6703a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:08 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b Aug 05 16:01:08 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "cinder-quobyte-316fd49f-45c2-49ee-a314-eddd6bd6703a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-316fd49f-45c2-49ee-a314-eddd6bd6703a" acquired by "delete_volume" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3293028-68bb-42b9-88fd-05a07dc8a5de]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:08 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a Aug 05 16:01:08 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b" returned: 0 in 0.503s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:08 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b Aug 05 16:01:08 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.768s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:08 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 Aug 05 16:01:08 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a" returned: 0 in 0.597s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:08 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f74a23c0-70a6-4067-83bc-03164ee5437b" returned: 0 in 0.435s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:08 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a Aug 05 16:01:08 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-f74a23c0-70a6-4067-83bc-03164ee5437b" released by "delete_volume" :: held 1.048s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['b8f63825-a11c-4c1b-a2db-751f48ae2f85', '1c801b4c-6600-4767-af62-da669135b561', '69f72d9c-853e-45a6-a30b-b6e41975b665', '74ed06a7-6a52-4bdc-bd6a-45204cdd2710'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:09 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:09 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:09 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-316fd49f-45c2-49ee-a314-eddd6bd6703a" returned: 0 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-quobyte-316fd49f-45c2-49ee-a314-eddd6bd6703a" released by "delete_volume" :: held 1.165s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Created reservations ['bc8ed357-142e-46a2-99c4-f9eeb2ec0c08', 'fcd7ded5-86c3-481e-ac5a-dfbe7f085ad9', '10e13945-f735-4973-a585-7f506d9343fc', 'a8247c17-0a3f-4a1e-8c6b-e28202c7b96b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:09 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.457s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Deleted volume successfully. Aug 05 16:01:09 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:09 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0b2f40ae-cf7e-4a9b-88df-1dd17bc02381 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-f74a23c0-70a6-4067-83bc-03164ee5437b-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:10 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.812s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Deleted volume successfully. Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-d9412100-aaed-4116-a9d0-d6450c50bbb5-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-291a1c49-f51d-450c-ab3b-e199c2a47438 tempest-CinderUnicodeTest-664648776 None] Lock "cinder-316fd49f-45c2-49ee-a314-eddd6bd6703a-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-d9412100-aaed-4116-a9d0-d6450c50bbb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Deleting offline snapshot d9412100-aaed-4116-a9d0-d6450c50bbb5 of volume 2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] snapshot_file for this snap is: volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47abff-98d8-484c-824b-fb4c58d39817]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:11 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:01:11 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:11 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 0.829s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b4591-d90f-4046-8fd3-107fb17feec1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:12 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:01:12 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:12 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.895s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:12 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:01:12 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:13 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 1.230s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:14 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5 Aug 05 16:01:14 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:15 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825.d9412100-aaed-4116-a9d0-d6450c50bbb5" returned: 0 in 1.070s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=134,cinder:SELECT=124,cinder:INSERT=28,cinder:DELETE=13 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=135,cinder:INSERT=43,cinder:UPDATE=163,cinder:DELETE=15 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-d9412100-aaed-4116-a9d0-d6450c50bbb5" released by "_delete_snapshot" :: held 4.485s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" released by "delete_snapshot" :: held 4.563s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['a8e8306d-11bd-4c00-a965-82672150985a', '02a8c6ce-5ffd-4bbc-b841-9a39f3c8c88b', '8dcff6c4-4e9f-4219-9f58-34c15553213d', '9912c17f-849e-44d3-99c8-1d8aac46009b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Delete snapshot completed successfully. Aug 05 16:01:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-90f7a7c2-5352-4a9f-9743-051949e80634 tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-d9412100-aaed-4116-a9d0-d6450c50bbb5-delete_snapshot" released by "delete_snapshot" :: held 5.235s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:16 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0" returned: 0 in 7.774s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954ac8c-a2cb-4c03-bdf3-e5fb6f96b25d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:16 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:01:16 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-2d1959cd-2c54-45d7-8ce3-a4e1973a0825-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-2d1959cd-2c54-45d7-8ce3-a4e1973a0825-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879b564-9bcb-451b-8083-d07070049e69]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:16 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:01:16 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:17 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.829s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:01:17 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Converted 1024.00 MB image at 131.68 MB/s Aug 05 16:01:17 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 is being set with open permissions: ugo+rw Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:17 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 Aug 05 16:01:17 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:17 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.484s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:17 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825 Aug 05 16:01:17 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:17 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0" returned: 0 in 0.417s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" released by "_copy_volume_from_snapshot" :: held 10.397s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-b5a854a8-d790-4a3d-91a4-276abf7b44d0" released by "_create_volume_from_snapshot" :: held 10.467s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.497s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144f69c3-5bf0-4d5b-9e68-b9c611efc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0', 'volume_size': 1, 'snapshot_id': '2e0b360e-06d7-4c75-9de1-d6c15d9f03e0'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d240f96-514b-4c91-86d5-3fe63a17914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:17 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Volume volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 (b5a854a8-d790-4a3d-91a4-276abf7b44d0): created successfully Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d240f96-514b-4c91-86d5-3fe63a17914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Flow 'volume_create_manager' (68d46ad4-0a5c-46ad-a15d-c3e1ecfa136e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-94c0f89d-2616-43dd-8fb6-a48ca91b8e2b tempest-TestStampPattern-1130938315 None] Created volume successfully. Aug 05 16:01:17 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" returned: 0 in 0.602s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-2d1959cd-2c54-45d7-8ce3-a4e1973a0825" released by "delete_volume" :: held 1.176s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['6c24e713-a924-412b-b929-01a9d9ad387b', '610fa70c-4e32-452b-97dd-7b372ff87d3d', 'f818c33d-96e4-4ac0-9f9b-32dc9b3cc5f8', '18459439-2d16-4f6f-a6da-c622f6c61af8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:18 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:18 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:18 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Deleted volume successfully. Aug 05 16:01:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-679ca32c-e8c1-4e3b-bda8-a98f054d2e6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-2d1959cd-2c54-45d7-8ce3-a4e1973a0825-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-c039463d-84d8-47d5-86c6-96179f350df0-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Flow 'volume_create_manager' (af066d3e-ed05-4718-b734-1d93b3eea3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b26f24-f8c0-40ec-9d65-03a793802eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-c039463d-84d8-47d5-86c6-96179f350df0-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b26f24-f8c0-40ec-9d65-03a793802eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668553457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54992129-daa0-4589-bcb0-f7fb6bae71d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46c8fba091442728a55a5bc59089e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:19Z,use_quota=True,user_id='ce616b9889c84ab19919b20353019712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52f234-71dc-4ba0-b372-d5155b62bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d52f234-71dc-4ba0-b372-d5155b62bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb77750-7369-4371-b78f-acf22a6633ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb77750-7369-4371-b78f-acf22a6633ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54992129-daa0-4589-bcb0-f7fb6bae71d2', 'volume_name': 'volume-54992129-daa0-4589-bcb0-f7fb6bae71d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ca014-204b-46ef-be0f-3233112e9ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ca014-204b-46ef-be0f-3233112e9ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7b5c9f-1e97-4ac4-8ced-b6d2317b3afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Volume 54992129-daa0-4589-bcb0-f7fb6bae71d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54992129-daa0-4589-bcb0-f7fb6bae71d2', 'volume_size': 1} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668553457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54992129-daa0-4589-bcb0-f7fb6bae71d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46c8fba091442728a55a5bc59089e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:19Z,use_quota=True,user_id='ce616b9889c84ab19919b20353019712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Creating volume 54992129-daa0-4589-bcb0-f7fb6bae71d2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:01:19 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:19 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 1073741824 Aug 05 16:01:19 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9ac3a-bbf0-49ef-b50e-0ba48b1950f7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:19 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 Aug 05 16:01:19 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:19 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0" returned: 0 in 0.457s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:19 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 1073741824" returned: 0 in 0.598s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:19 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0 Aug 05 16:01:19 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:19 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 Aug 05 16:01:19 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:20 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c039463d-84d8-47d5-86c6-96179f350df0" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-quobyte-c039463d-84d8-47d5-86c6-96179f350df0" released by "delete_volume" :: held 0.892s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:20 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2" returned: 0 in 0.336s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7b5c9f-1e97-4ac4-8ced-b6d2317b3afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54992129-daa0-4589-bcb0-f7fb6bae71d2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06239771-fb95-41db-91f3-f6db38fd9aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Volume volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 (54992129-daa0-4589-bcb0-f7fb6bae71d2): created successfully Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06239771-fb95-41db-91f3-f6db38fd9aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Flow 'volume_create_manager' (af066d3e-ed05-4718-b734-1d93b3eea3bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-42d664df-5dac-4f5f-b8dc-b2f3e6df5127 tempest-ProjectReaderTests-87743080 None] Created volume successfully. Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Created reservations ['ca982428-c07d-48a6-9014-b4c262e65052', '6de405cb-6427-40e0-b098-6b8072baad79', '4ecaf452-976b-439a-a5f6-edc78d5e2216', '71a0e819-6c4f-4056-b809-81fb904960e2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:20 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:20 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:20 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.283s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Deleted volume successfully. Aug 05 16:01:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c49f3ca7-02a1-4f8b-ae1c-261ac0e9da6b tempest-VolumesSnapshotTestJSON-1556294135 None] Lock "cinder-c039463d-84d8-47d5-86c6-96179f350df0-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Acquiring lock "cinder-54992129-daa0-4589-bcb0-f7fb6bae71d2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "cinder-54992129-daa0-4589-bcb0-f7fb6bae71d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Acquiring lock "cinder-quobyte-54992129-daa0-4589-bcb0-f7fb6bae71d2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "cinder-quobyte-54992129-daa0-4589-bcb0-f7fb6bae71d2" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87aa5e2-adc3-4b10-ab94-5f29cc5a6de8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:21 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 Aug 05 16:01:21 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:22 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2" returned: 0 in 0.490s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:22 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2 Aug 05 16:01:22 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:22 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-54992129-daa0-4589-bcb0-f7fb6bae71d2" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "cinder-quobyte-54992129-daa0-4589-bcb0-f7fb6bae71d2" released by "delete_volume" :: held 0.902s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Created reservations ['a030396e-a0fe-478c-a431-ecb60a1d0cb7', 'ef5ec4bd-2cdb-46de-8aa8-623ce3322cdb', 'a07cafa7-19e5-43d5-8e67-6524af49fca0', '11a01028-3185-437d-b065-f84913dc0755'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:22 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:22 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:22 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:22 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Deleted volume successfully. Aug 05 16:01:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0e2d0511-83fc-4f2c-983b-9c3a0e9c96ea tempest-ProjectReaderTests-87743080 None] Lock "cinder-54992129-daa0-4589-bcb0-f7fb6bae71d2-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Flow 'volume_create_manager' (2bdfd33b-5502-4434-9542-a32c3a180e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae78645-fe89-4923-90a5-f777b375eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae78645-fe89-4923-90a5-f777b375eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388469595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c749e04-0e21-46f6-a614-dbefdb87b336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46c8fba091442728a55a5bc59089e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:24Z,use_quota=True,user_id='ce616b9889c84ab19919b20353019712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6eb15b-bf02-416f-a8f1-3e5ecbac7de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6eb15b-bf02-416f-a8f1-3e5ecbac7de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b42a8-e024-4e4d-865a-a1c36135b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4b42a8-e024-4e4d-865a-a1c36135b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c749e04-0e21-46f6-a614-dbefdb87b336', 'volume_name': 'volume-3c749e04-0e21-46f6-a614-dbefdb87b336', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ade30f-f0c5-4cd7-9953-d0ca1e7bcc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ade30f-f0c5-4cd7-9953-d0ca1e7bcc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57f972c-fd3f-4841-8416-24e8b2601415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Volume 3c749e04-0e21-46f6-a614-dbefdb87b336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c749e04-0e21-46f6-a614-dbefdb87b336', 'volume_size': 1} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388469595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c749e04-0e21-46f6-a614-dbefdb87b336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46c8fba091442728a55a5bc59089e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:24Z,use_quota=True,user_id='ce616b9889c84ab19919b20353019712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Creating volume 3c749e04-0e21-46f6-a614-dbefdb87b336 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:01:24 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:24 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 1073741824 Aug 05 16:01:24 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:24 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 1073741824" returned: 0 in 0.448s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:24 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 Aug 05 16:01:24 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:25 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57f972c-fd3f-4841-8416-24e8b2601415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c749e04-0e21-46f6-a614-dbefdb87b336', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2583b70-3ef4-45da-9323-3c7fe89a5cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:25 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Volume volume-3c749e04-0e21-46f6-a614-dbefdb87b336 (3c749e04-0e21-46f6-a614-dbefdb87b336): created successfully Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2583b70-3ef4-45da-9323-3c7fe89a5cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Flow 'volume_create_manager' (2bdfd33b-5502-4434-9542-a32c3a180e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-981c505f-72e2-4377-9d5c-cfba750ff38d tempest-ProjectReaderTests-87743080 None] Created volume successfully. Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Acquiring lock "cinder-3c749e04-0e21-46f6-a614-dbefdb87b336-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "cinder-3c749e04-0e21-46f6-a614-dbefdb87b336-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Acquiring lock "cinder-quobyte-3c749e04-0e21-46f6-a614-dbefdb87b336" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "cinder-quobyte-3c749e04-0e21-46f6-a614-dbefdb87b336" acquired by "delete_volume" :: waited 0.046s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115a3cd-7108-4724-a475-1682dc591f64]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:25 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 Aug 05 16:01:25 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:25 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336" returned: 0 in 0.444s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:26 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336 Aug 05 16:01:26 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:26 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3c749e04-0e21-46f6-a614-dbefdb87b336" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "cinder-quobyte-3c749e04-0e21-46f6-a614-dbefdb87b336" released by "delete_volume" :: held 0.826s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Created reservations ['e73f893f-a543-431a-8325-bbf8249635e4', '9473ba87-c4f1-4d11-b599-1f6b118a5008', '31058791-112c-4162-9f34-cd83d70c4e38', '52f30c65-ae8a-44b9-8096-89eaebfd55a1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:26 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:26 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:26 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Deleted volume successfully. Aug 05 16:01:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b4ec38fc-a087-45f1-9f67-d2d75554be68 tempest-ProjectReaderTests-87743080 None] Lock "cinder-3c749e04-0e21-46f6-a614-dbefdb87b336-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Flow 'volume_create_manager' (337feb2e-350b-44b2-ad68-f73aff942174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e507dabc-d0a3-44e4-932b-2a94acc592d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e507dabc-d0a3-44e4-932b-2a94acc592d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1112686594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837fb649-dbe3-4aaf-ba81-acbd4b2dfce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c4706922ed436e9601a22ab8a6a347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:29Z,use_quota=True,user_id='80f33bfbdbfd4795ae79950c55d6fc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5578d7c-eb47-47da-b339-a02bcfdf8a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5578d7c-eb47-47da-b339-a02bcfdf8a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1af628-ac28-40bd-9e24-3cf3bc30fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1af628-ac28-40bd-9e24-3cf3bc30fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837fb649-dbe3-4aaf-ba81-acbd4b2dfce5', 'volume_name': 'volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe824819-dab7-4a30-9699-f820d839c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe824819-dab7-4a30-9699-f820d839c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd9bc20-6aef-48e4-99fb-8fb4845f6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5', 'volume_size': 1} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1112686594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837fb649-dbe3-4aaf-ba81-acbd4b2dfce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c4706922ed436e9601a22ab8a6a347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:01:29Z,use_quota=True,user_id='80f33bfbdbfd4795ae79950c55d6fc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Creating volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:01:29 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:01:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:29 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 1073741824 Aug 05 16:01:29 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:30 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 1073741824" returned: 0 in 0.481s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:30 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 Aug 05 16:01:30 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:30 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd9bc20-6aef-48e4-99fb-8fb4845f6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267f11ea-93cc-4b3f-a0d3-52e6808ac2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:01:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Volume volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 (837fb649-dbe3-4aaf-ba81-acbd4b2dfce5): created successfully Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267f11ea-93cc-4b3f-a0d3-52e6808ac2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:01:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Flow 'volume_create_manager' (337feb2e-350b-44b2-ad68-f73aff942174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:01:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f4584e39-2134-446d-804c-66344a1a56cb tempest-VolumesSnapshotListTestJSON-139582626 None] Created volume successfully. Aug 05 16:01:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Creating offline snapshot c175afb0-335d-4170-b370-33f080d0e514 of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:01:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b59f2f-0b83-46d5-b4c3-fb59dfc47919]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:31 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 Aug 05 16:01:31 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:32 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" returned: 0 in 0.379s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:32 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 1G Aug 05 16:01:32 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:32 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 1G" returned: 0 in 0.448s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:32 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:32 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:32 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.330s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:32 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 is being set with open permissions: ugo+rw Aug 05 16:01:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:33 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:33 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:33 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.255s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:33 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info Aug 05 16:01:33 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:33 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:33 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info is being set with open permissions: ugo+rw Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:33 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info Aug 05 16:01:33 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:33 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.info" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1c5ff1f5-5a9a-4fc0-b0ab-9b69c8489bbd tempest-VolumesSnapshotListTestJSON-139582626 None] Create snapshot completed successfully Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Creating offline snapshot 2049ea69-c501-4b9a-bf3b-ed6f57705024 of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b9c3e-1d6b-4a37-a0a0-8e673da89c82]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:35 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:35 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:35 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.359s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:35 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 1G Aug 05 16:01:35 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:35 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 1G" returned: 0 in 0.423s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:35 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:35 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:36 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:36 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 is being set with open permissions: ugo+rw Aug 05 16:01:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:36 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:36 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:36 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.255s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.418s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:36 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-66f1cb45-16b7-48c2-8e37-4c55b086b341 tempest-VolumesSnapshotListTestJSON-139582626 None] Create snapshot completed successfully Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Creating offline snapshot de530510-466f-4131-9169-a81c9b9944fb of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[884b145e-e0f9-4406-8dfd-7ed7c8cce99e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:37 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:37 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:37 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:37 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb 1G Aug 05 16:01:37 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:38 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb 1G" returned: 0 in 0.449s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:38 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb Aug 05 16:01:38 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:38 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb" returned: 0 in 0.294s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb is being set with open permissions: ugo+rw Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:38 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb Aug 05 16:01:38 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:38 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.448s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7574bc81-cde3-4830-9226-1cd7eabdecb7 tempest-VolumesSnapshotListTestJSON-139582626 None] Create snapshot completed successfully Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-de530510-466f-4131-9169-a81c9b9944fb-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-de530510-466f-4131-9169-a81c9b9944fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-de530510-466f-4131-9169-a81c9b9944fb" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-de530510-466f-4131-9169-a81c9b9944fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Deleting offline snapshot de530510-466f-4131-9169-a81c9b9944fb of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] snapshot_file for this snap is: volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0516f-6e2a-4fef-835b-13d376da8c3f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:40 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb Aug 05 16:01:40 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:40 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768948f-dd30-4b42-a75a-bc60bc11735d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:40 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:40 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:41 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:41 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb Aug 05 16:01:41 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:41 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:41 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb Aug 05 16:01:41 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:41 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.de530510-466f-4131-9169-a81c9b9944fb" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-de530510-466f-4131-9169-a81c9b9944fb" released by "_delete_snapshot" :: held 1.514s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" released by "delete_snapshot" :: held 1.535s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Created reservations ['686dacd7-b257-4309-a861-1b3c73767c4a', '40c4f38c-e382-4fcd-8e12-9bd29f0e0a7f', '757e4827-65c3-4d55-b41d-8d8ef9426f77', 'b400a216-4268-4c7e-af3b-b232aea1eb3b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Delete snapshot completed successfully. Aug 05 16:01:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-264bda49-29c4-4b50-aca7-253a92fd6047 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-de530510-466f-4131-9169-a81c9b9944fb-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-2049ea69-c501-4b9a-bf3b-ed6f57705024-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-2049ea69-c501-4b9a-bf3b-ed6f57705024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-2049ea69-c501-4b9a-bf3b-ed6f57705024" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-2049ea69-c501-4b9a-bf3b-ed6f57705024" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Deleting offline snapshot 2049ea69-c501-4b9a-bf3b-ed6f57705024 of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] snapshot_file for this snap is: volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf512476-a00a-4ad3-977d-96561e384fbe]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:42 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:42 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:42 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf347b3-6ef2-4927-9e16-28ea61ea9ac8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:42 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:43 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:43 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.379s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:43 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:43 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:43 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.366s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:43 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024 Aug 05 16:01:43 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:43 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.2049ea69-c501-4b9a-bf3b-ed6f57705024" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-2049ea69-c501-4b9a-bf3b-ed6f57705024" released by "_delete_snapshot" :: held 1.492s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" released by "delete_snapshot" :: held 1.511s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Created reservations ['2a7896a7-1710-4ac4-a9cf-e185ef18b93e', '0ce92710-fec5-4fa9-b348-1c7bb176b1d6', '18af3c22-7082-4a46-a684-f39db2bb8e97', '05f612aa-0fb8-42f7-a98a-ba7291b19c67'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Delete snapshot completed successfully. Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-00e5e373-20b9-4bb8-a4a9-cce3319a6cf1 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-2049ea69-c501-4b9a-bf3b-ed6f57705024-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-c175afb0-335d-4170-b370-33f080d0e514-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-c175afb0-335d-4170-b370-33f080d0e514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-c175afb0-335d-4170-b370-33f080d0e514" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-c175afb0-335d-4170-b370-33f080d0e514" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Deleting offline snapshot c175afb0-335d-4170-b370-33f080d0e514 of volume 837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] snapshot_file for this snap is: volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc1ec7e-2f46-48f1-b66b-f26ecbe69a5f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:44 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:44 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:45 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.419s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[303bced2-2a93-4589-95e6-782c03941f7c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:45 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 Aug 05 16:01:45 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa885da-bf91-41a4-8f86-2446413d7800]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:45 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 Aug 05 16:01:45 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:45 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:45 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:45 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:45 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.398s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f18b4202-2d11-4e1b-99c5-339a82f6be61', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:01:45 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-1b30eb82-890c-4e40-adde-a4cb9b0cd6c8 req-f40bd390-8b65-420c-a697-431cabbe1e5e tempest-TestStampPattern-1130938315 None] attachment_update completed successfully. Aug 05 16:01:45 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.372s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:45 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514 Aug 05 16:01:45 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:46 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5.c175afb0-335d-4170-b370-33f080d0e514" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-c175afb0-335d-4170-b370-33f080d0e514" released by "_delete_snapshot" :: held 1.591s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" released by "delete_snapshot" :: held 1.614s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Created reservations ['ea123920-d650-4c8e-b1cf-ca6df8768040', '13479a2a-9ba9-43fb-b61e-b64b8d6ccc3f', '12b544ab-9e11-47af-85cf-3cd2d3423d11', 'e5bad490-7742-4af6-92ed-1d337ec5af64'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:46 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Delete snapshot completed successfully. Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a3732b4c-4582-41b5-bcf8-a0d2433d34a8 tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-c175afb0-335d-4170-b370-33f080d0e514-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5a5b75-4e27-459d-a7b9-934c9ab04dac]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:46 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 Aug 05 16:01:46 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:47 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:47 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5 Aug 05 16:01:47 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:47 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" returned: 0 in 0.255s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-quobyte-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5" released by "delete_volume" :: held 0.703s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Created reservations ['153637ec-22cb-453d-bec3-76ce39e34920', 'cef7cbc1-e9cd-4be9-a335-0cc2873590b3', 'b640d6cc-d4a4-4aad-8490-06855c3252c8', '3b1e5c7d-18d5-4cb0-9262-e1ea54404d0e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:47 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:47 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:47 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Deleted volume successfully. Aug 05 16:01:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7f4888bf-fbb4-439c-a852-08f2f3ee3a1b tempest-VolumesSnapshotListTestJSON-139582626 None] Lock "cinder-837fb649-dbe3-4aaf-ba81-acbd4b2dfce5-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:48 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-40110ef0-81c3-4786-8730-8c5a8a9e088e req-c0f9bb79-ab4a-4de5-89b3-5239cc3a45c3 tempest-TestStampPattern-1130938315 None] Terminate volume connection completed successfully. Aug 05 16:01:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-40110ef0-81c3-4786-8730-8c5a8a9e088e req-c0f9bb79-ab4a-4de5-89b3-5239cc3a45c3 tempest-TestStampPattern-1130938315 None] Deleting attachment f18b4202-2d11-4e1b-99c5-339a82f6be61. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-b5a854a8-d790-4a3d-91a4-276abf7b44d0-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "cinder-b5a854a8-d790-4a3d-91a4-276abf7b44d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb76a69-ca3f-41c0-b997-77e5b01220d2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:53 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 Aug 05 16:01:53 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:53 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0" returned: 0 in 0.395s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:53 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0 Aug 05 16:01:53 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:54 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b5a854a8-d790-4a3d-91a4-276abf7b44d0" returned: 0 in 0.263s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-b5a854a8-d790-4a3d-91a4-276abf7b44d0" released by "delete_volume" :: held 0.702s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Created reservations ['8f0e7f97-1258-4304-80f2-cd298cbcffa2', '6812a769-017e-459f-98fd-0710c6649404', '5287ab41-79cc-44b9-af53-6c72529a91ca', 'a3d769f6-56d2-4271-a792-d04c78d1b1b3'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:54 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:01:54 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:54 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.305s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:01:54 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Deleted volume successfully. Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-04052a50-d68b-44a1-8b3d-88cfa093f8dc tempest-TestStampPattern-1130938315 None] Lock "cinder-b5a854a8-d790-4a3d-91a4-276abf7b44d0-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Deleting offline snapshot 2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 of volume cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] snapshot_file for this snap is: volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2588b91-b74e-4114-9ce2-06fe01c60f6f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:55 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:01:55 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:55 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.404s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cca435c0-e381-4276-ae57-ff2677678c87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0fd89-de5c-4c81-8493-7f733e3a1485]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:55 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:01:55 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:55 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.493s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:55 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:01:55 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:56 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.376s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:01:56 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0 Aug 05 16:01:56 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:01:56 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87.2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0" released by "_delete_snapshot" :: held 1.650s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" released by "delete_snapshot" :: held 1.680s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Created reservations ['3d911f58-ccb3-47cf-aff1-97785311078f', '9ccee867-696c-4b12-8d31-4549d8b8cae3', 'e96b03e7-ef42-418a-b9f6-4a0d733ccfe6', 'ff6a6672-1c33-4d97-9b9b-1f8e280e3d50'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:01:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Delete snapshot completed successfully. Aug 05 16:01:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-bcd49e96-c05a-4d99-90e9-b872eb8a89d9 tempest-TestStampPattern-1130938315 None] Lock "cinder-2e0b360e-06d7-4c75-9de1-d6c15d9f03e0-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-cca435c0-e381-4276-ae57-ff2677678c87-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "cinder-cca435c0-e381-4276-ae57-ff2677678c87-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Acquiring lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ff8cb-477b-4751-8c12-b91402366320]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:01 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:02:01 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:01 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:01 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87 Aug 05 16:02:01 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:01 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cca435c0-e381-4276-ae57-ff2677678c87" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "cinder-quobyte-cca435c0-e381-4276-ae57-ff2677678c87" released by "delete_volume" :: held 0.777s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Created reservations ['668c2d9b-5c1d-43c9-8222-a5f4a9a58b61', '12bb6888-2460-48f4-908b-8f9719cf7bdc', '4a2fdab4-59b5-4e06-a31b-e6821c1b38a5', '85b0a800-225d-46ed-9396-818ab4cc1363'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:02 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:02 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:02 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.256s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Deleted volume successfully. Aug 05 16:02:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad8b1f79-6b2f-4a17-9373-a01e50fb0e42 tempest-TestStampPattern-1130938315 None] Lock "cinder-cca435c0-e381-4276-ae57-ff2677678c87-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:03 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:03 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:03 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.268s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:02:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:02:12 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=89,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:02:12 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (6d5e2195-6f7f-4d9d-a2fe-6e0f8931822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb86bd-09b8-42ba-a7ac-b3714202dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb86bd-09b8-42ba-a7ac-b3714202dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657719780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8302b1-b879-4325-8334-8b371d18575c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:16Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb82df6b-c8e2-4f56-ac90-2749deb1ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb82df6b-c8e2-4f56-ac90-2749deb1ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e8e683-4b26-4bb6-a877-57b5c7089c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e8e683-4b26-4bb6-a877-57b5c7089c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8302b1-b879-4325-8334-8b371d18575c', 'volume_name': 'volume-af8302b1-b879-4325-8334-8b371d18575c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebef45c-e3b9-4581-9bb2-14421d949846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebef45c-e3b9-4581-9bb2-14421d949846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90a959-39f0-4912-93b0-f1fb3f596146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Volume af8302b1-b879-4325-8334-8b371d18575c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8302b1-b879-4325-8334-8b371d18575c', 'volume_size': 1} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1657719780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8302b1-b879-4325-8334-8b371d18575c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:16Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Creating volume af8302b1-b879-4325-8334-8b371d18575c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:16 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:16 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c 1073741824 Aug 05 16:02:16 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:16 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c 1073741824" returned: 0 in 0.451s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:16 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c Aug 05 16:02:16 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:16 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c" returned: 0 in 0.316s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90a959-39f0-4912-93b0-f1fb3f596146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8302b1-b879-4325-8334-8b371d18575c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae7174-8ada-4c91-9f8b-7a261fb52b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Volume volume-af8302b1-b879-4325-8334-8b371d18575c (af8302b1-b879-4325-8334-8b371d18575c): created successfully Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae7174-8ada-4c91-9f8b-7a261fb52b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (6d5e2195-6f7f-4d9d-a2fe-6e0f8931822c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5f387911-d01c-476f-95d4-b1eeae19ca19 tempest-ProjectReaderTests-27607167 None] Created volume successfully. Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (16cbef42-ddfe-4f1d-acd8-a63d8d9c2e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee00aaf6-c862-4dbd-a526-1c738081b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee00aaf6-c862-4dbd-a526-1c738081b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2142437700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbbe604-0f12-4b57-9538-24df1cd5c869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:18Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ec768bd-80e9-4a66-9e9b-b94c1805e7a9),volume_type_id=4ec768bd-80e9-4a66-9e9b-b94c1805e7a9)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe4c544-30d3-47c1-b8c6-83c0912f48ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe4c544-30d3-47c1-b8c6-83c0912f48ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34570ed-d8e8-4367-8f37-dc1dee0a87f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34570ed-d8e8-4367-8f37-dc1dee0a87f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbbe604-0f12-4b57-9538-24df1cd5c869', 'volume_name': 'volume-6fbbe604-0f12-4b57-9538-24df1cd5c869', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669e82a-2d2b-40c8-ac57-f9a3892a005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669e82a-2d2b-40c8-ac57-f9a3892a005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a27d61-22cb-495c-85c1-1997cfd31190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:17 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume 6fbbe604-0f12-4b57-9538-24df1cd5c869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbbe604-0f12-4b57-9538-24df1cd5c869', 'volume_size': 1} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2142437700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbbe604-0f12-4b57-9538-24df1cd5c869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:18Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ec768bd-80e9-4a66-9e9b-b94c1805e7a9),volume_type_id=4ec768bd-80e9-4a66-9e9b-b94c1805e7a9)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Creating volume 6fbbe604-0f12-4b57-9538-24df1cd5c869 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:17 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:17 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 1073741824 Aug 05 16:02:17 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (6756463a-1e0c-42e1-a523-2cf169e6e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5084d34-7e55-45fd-ac0f-ac41441235c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-af8302b1-b879-4325-8334-8b371d18575c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5084d34-7e55-45fd-ac0f-ac41441235c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847525692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:18Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e49d5e73-b1bf-4076-b5ac-c4e93dcbed23),volume_type_id=e49d5e73-b1bf-4076-b5ac-c4e93dcbed23)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e948dc10-e96c-49dd-a2ca-7d2b7d3117f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e948dc10-e96c-49dd-a2ca-7d2b7d3117f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a711ef6-63f9-49c7-9ec1-dfce7d240145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a711ef6-63f9-49c7-9ec1-dfce7d240145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f', 'volume_name': 'volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f61084-605a-4487-9183-91c4021a2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f61084-605a-4487-9183-91c4021a2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baee4cf2-2de0-4d54-9813-9f38b7267687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f', 'volume_size': 1} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "cinder-af8302b1-b879-4325-8334-8b371d18575c-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:18 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-quobyte-af8302b1-b879-4325-8334-8b371d18575c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 1073741824" returned: 0 in 0.540s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-af8302b1-b879-4325-8334-8b371d18575c" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e747ce61-ab22-4aa3-b2db-624a17253651]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:18 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 Aug 05 16:02:18 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:18 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c Aug 05 16:02:18 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:18 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-847525692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:18Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e49d5e73-b1bf-4076-b5ac-c4e93dcbed23),volume_type_id=e49d5e73-b1bf-4076-b5ac-c4e93dcbed23)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Creating volume a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:18 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:18 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f 1073741824 Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a27d61-22cb-495c-85c1-1997cfd31190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbbe604-0f12-4b57-9538-24df1cd5c869', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f06eb4-247e-4162-be29-f4de6fce0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 (6fbbe604-0f12-4b57-9538-24df1cd5c869): created successfully Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f06eb4-247e-4162-be29-f4de6fce0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (16cbef42-ddfe-4f1d-acd8-a63d8d9c2e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:18 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c" returned: 0 in 0.411s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e1f37ddb-1430-44bc-9cd2-5d6630532e0e tempest-TestInstancesWithCinderVolumes-1834772897 None] Created volume successfully. Aug 05 16:02:18 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c Aug 05 16:02:18 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (6ea1462a-0ab7-4a37-ad12-37a32fd872dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f79d2f-d802-49e3-b1d1-88b8d59a02b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f79d2f-d802-49e3-b1d1-88b8d59a02b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2032957156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309038b5-918b-4bc8-bcab-ccf58f6ec3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:19Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85eeb4a7-472e-41a7-81f4-f1c1b2b0723e),volume_type_id=85eeb4a7-472e-41a7-81f4-f1c1b2b0723e)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca287dd7-859b-45c6-ab01-aeaf0b12d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca287dd7-859b-45c6-ab01-aeaf0b12d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29220ed-1fe0-4d33-b712-2e3305ab9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:18 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 16:02:19 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-af8302b1-b879-4325-8334-8b371d18575c" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-af8302b1-b879-4325-8334-8b371d18575c" released by "delete_volume" :: held 0.741s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Created reservations ['614a883a-748e-4fbf-ba19-f4f800304112', '42a56341-a208-4c14-976d-8138e5c5692d', 'ca3309f4-c5aa-42c0-9b2f-903f9fb67aa7', '1277a731-6fff-4878-9187-3ac8a2f4de1e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:02:19 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f 1073741824" returned: 0 in 0.496s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:19 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:19 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:19 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f Aug 05 16:02:19 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29220ed-1fe0-4d33-b712-2e3305ab9083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '309038b5-918b-4bc8-bcab-ccf58f6ec3fe', 'volume_name': 'volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe', 'volume_size': 1, 'image_id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--64321554', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53620c961bd043cb905698c9106d6c20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'created_at': datetime.datetime(2026, 8, 5, 14, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ce830e-daea-49f1-9fd5-ce8d580862c3/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f4d2d5-dc9f-4215-bcc4-89efaa48ce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f4d2d5-dc9f-4215-bcc4-89efaa48ce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda51df-e620-40e0-a278-3f88e8891f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe', 'volume_size': 1, 'image_id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--64321554', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53620c961bd043cb905698c9106d6c20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'created_at': datetime.datetime(2026, 8, 5, 14, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ce830e-daea-49f1-9fd5-ce8d580862c3/file', 'properties': {}}, 'image_service': } Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Trying to clone 309038b5-918b-4bc8-bcab-ccf58f6ec3fe from image 56ce830e-daea-49f1-9fd5-ce8d580862c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 16:02:19 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:19 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baee4cf2-2de0-4d54-9813-9f38b7267687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02c8e99-9586-448c-bf86-9ef8a34d51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.350s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Deleted volume successfully. Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f (a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f): created successfully Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02c8e99-9586-448c-bf86-9ef8a34d51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (6756463a-1e0c-42e1-a523-2cf169e6e54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4d203cdf-acfc-4cd1-b17e-3bef8c70765c tempest-TestInstancesWithCinderVolumes-1834772897 None] Created volume successfully. Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-808cc235-3989-421a-a55c-5460eae21798 tempest-ProjectReaderTests-27607167 None] Lock "cinder-af8302b1-b879-4325-8334-8b371d18575c-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (c2ece206-0f20-4286-a675-df152c61d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07c4607-1e97-41c1-9dab-407e63b4b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07c4607-1e97-41c1-9dab-407e63b4b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234089786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c337924-745d-44a2-8b19-8d3aa913dc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:20Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f5f771-1e06-45ff-9108-08e0ec441bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f5f771-1e06-45ff-9108-08e0ec441bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e878eb7b-3468-4169-8418-751f96ffcc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e878eb7b-3468-4169-8418-751f96ffcc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c337924-745d-44a2-8b19-8d3aa913dc60', 'volume_name': 'volume-4c337924-745d-44a2-8b19-8d3aa913dc60', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a806f02-27bc-4640-8d2b-111561427ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a806f02-27bc-4640-8d2b-111561427ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c939f-615b-494a-8596-09c29e8543d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Volume 4c337924-745d-44a2-8b19-8d3aa913dc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c337924-745d-44a2-8b19-8d3aa913dc60', 'volume_size': 1} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234089786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c337924-745d-44a2-8b19-8d3aa913dc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:20Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Creating volume 4c337924-745d-44a2-8b19-8d3aa913dc60 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:19 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:19 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 1073741824 Aug 05 16:02:19 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:20 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 1073741824" returned: 0 in 0.457s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:20 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 Aug 05 16:02:20 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:20 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60" returned: 0 in 0.275s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c939f-615b-494a-8596-09c29e8543d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c337924-745d-44a2-8b19-8d3aa913dc60', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbf9f18-1e79-4a1c-976b-de5af4373f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Volume volume-4c337924-745d-44a2-8b19-8d3aa913dc60 (4c337924-745d-44a2-8b19-8d3aa913dc60): created successfully Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbf9f18-1e79-4a1c-976b-de5af4373f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (c2ece206-0f20-4286-a675-df152c61d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-56b4b762-e5b2-4a9e-8758-ec4ff612eb63 tempest-ProjectReaderTests-27607167 None] Created volume successfully. Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-4c337924-745d-44a2-8b19-8d3aa913dc60-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "cinder-4c337924-745d-44a2-8b19-8d3aa913dc60-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-quobyte-4c337924-745d-44a2-8b19-8d3aa913dc60" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-4c337924-745d-44a2-8b19-8d3aa913dc60" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c7dba0-779e-4816-9f9a-75602a859e19]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:21 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 Aug 05 16:02:21 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:21 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60" returned: 0 in 0.371s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:21 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60 Aug 05 16:02:21 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:21 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-4c337924-745d-44a2-8b19-8d3aa913dc60" returned: 0 in 0.265s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-4c337924-745d-44a2-8b19-8d3aa913dc60" released by "delete_volume" :: held 0.683s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Created reservations ['bb515d3f-19e0-46ec-8f6e-ca347ce62ecb', 'c36afba4-7b3d-4190-b99a-afe2c4e4987b', 'f84f27e2-974f-4a58-8434-1a9409340767', '48fdd544-607b-4335-b442-8aa60ae3c097'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:21 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:21 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:22 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.281s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Deleted volume successfully. Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2abacb68-109b-4070-a948-9b5439a9759c tempest-ProjectReaderTests-27607167 None] Lock "cinder-4c337924-745d-44a2-8b19-8d3aa913dc60-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (54522ef3-f582-4940-95e0-4a723c9c33cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a742348-0301-4708-ae71-faa02894f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a742348-0301-4708-ae71-faa02894f24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907875261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12816448-e26e-4107-a6c5-452d0984c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:23Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3aa90-82bc-42fa-b313-3cfc2892b190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b3aa90-82bc-42fa-b313-3cfc2892b190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378768c4-439d-4edc-8ce2-9e66a59b0a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378768c4-439d-4edc-8ce2-9e66a59b0a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12816448-e26e-4107-a6c5-452d0984c23c', 'volume_name': 'volume-12816448-e26e-4107-a6c5-452d0984c23c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64f3b0e-23d8-4d87-9981-d597b1a8b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64f3b0e-23d8-4d87-9981-d597b1a8b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8fd803-9691-4e4c-b388-a046f0004db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Volume 12816448-e26e-4107-a6c5-452d0984c23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12816448-e26e-4107-a6c5-452d0984c23c', 'volume_size': 1} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907875261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12816448-e26e-4107-a6c5-452d0984c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:23Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Creating volume 12816448-e26e-4107-a6c5-452d0984c23c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:22 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:22 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c 1073741824 Aug 05 16:02:22 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:23 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD, size 20.69 MB, duration 3.79 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 16:02:23 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Image download 20.69 MB at 5.45 MB/s Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c 1073741824" returned: 0 in 0.440s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6faa8f0-4cf6-42c2-827e-26f2c66fda89]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:23 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c Aug 05 16:02:23 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:23 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD Aug 05 16:02:23 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:23 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c" returned: 0 in 0.244s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8fd803-9691-4e4c-b388-a046f0004db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12816448-e26e-4107-a6c5-452d0984c23c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77421bfc-fba3-4a2b-ab29-c434bd333802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:23 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Volume volume-12816448-e26e-4107-a6c5-452d0984c23c (12816448-e26e-4107-a6c5-452d0984c23c): created successfully Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77421bfc-fba3-4a2b-ab29-c434bd333802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (54522ef3-f582-4940-95e0-4a723c9c33cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-adb5ce1f-d1d6-48ff-bd81-3f0ebb17386e tempest-ProjectReaderTests-27607167 None] Created volume successfully. Aug 05 16:02:23 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Temporary image 56ce830e-daea-49f1-9fd5-ce8d580862c3 is fetched for user b029f70f014f48089c8c39253491685c. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53fefe0-bdbd-4e2b-88ae-b97d9fd78aed]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:23 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD Aug 05 16:02:23 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:23 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2032957156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309038b5-918b-4bc8-bcab-ccf58f6ec3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53620c961bd043cb905698c9106d6c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:19Z,use_quota=True,user_id='b029f70f014f48089c8c39253491685c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85eeb4a7-472e-41a7-81f4-f1c1b2b0723e),volume_type_id=85eeb4a7-472e-41a7-81f4-f1c1b2b0723e)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Creating volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:23 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:23 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1073741824 Aug 05 16:02:23 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:24 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1073741824" returned: 0 in 0.403s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:24 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:24 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:24 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Attempting download of 56ce830e-daea-49f1-9fd5-ce8d580862c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}])) to volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe3672-708a-496f-a547-69af26659146]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-12816448-e26e-4107-a6c5-452d0984c23c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "cinder-12816448-e26e-4107-a6c5-452d0984c23c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-quobyte-12816448-e26e-4107-a6c5-452d0984c23c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:24 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-12816448-e26e-4107-a6c5-452d0984c23c" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:24 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569fa7a-9345-464e-9bdc-7764024da2ec]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:24 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c Aug 05 16:02:24 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g" returned: 0 in 0.330s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:25 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g Aug 05 16:02:25 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c" returned: 0 in 0.389s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:25 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c Aug 05 16:02:25 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g" returned: 1 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56ce830e-daea-49f1-9fd5-ce8d580862c3_i1zk9s4g' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d35a1-9955-4cd4-b067-4075f22e0919]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:25 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-12816448-e26e-4107-a6c5-452d0984c23c" returned: 0 in 0.259s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD Aug 05 16:02:25 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-12816448-e26e-4107-a6c5-452d0984c23c" released by "delete_volume" :: held 0.693s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Created reservations ['aaba5a07-7890-43ba-9d08-e6e535b2e142', 'fca23269-05a4-4756-9e53-a6f03f9a9cc5', '082e192d-47a4-4250-9d5d-18b91a36db67', '93a55c01-8ff1-45e2-8cab-f4efb62f3190'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:25 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:25 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] 56ce830e-daea-49f1-9fd5-ce8d580862c3 was qcow2, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:25 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:25 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:25 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.259s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Deleted volume successfully. Aug 05 16:02:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3210ccee-5f04-49e3-8cd5-f77ca38a3028 tempest-ProjectReaderTests-27607167 None] Lock "cinder-12816448-e26e-4107-a6c5-452d0984c23c-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (af420811-cf74-4f11-a7dd-6934d1bace43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8359de55-7f27-4f85-a982-8e68b17a3972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8359de55-7f27-4f85-a982-8e68b17a3972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072834230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749cd622-5eae-4db5-8782-73b18f065482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:26Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8c6fe4-f3bd-4c14-94d8-0cf35940e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8c6fe4-f3bd-4c14-94d8-0cf35940e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7443f-2755-49f3-a350-20e30be6b393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7443f-2755-49f3-a350-20e30be6b393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749cd622-5eae-4db5-8782-73b18f065482', 'volume_name': 'volume-749cd622-5eae-4db5-8782-73b18f065482', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4f8930-4bf3-4664-b671-c11c8d4fdda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4f8930-4bf3-4664-b671-c11c8d4fdda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eef304-434c-48f1-86fa-39006191b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Volume 749cd622-5eae-4db5-8782-73b18f065482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749cd622-5eae-4db5-8782-73b18f065482', 'volume_size': 1} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072834230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749cd622-5eae-4db5-8782-73b18f065482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9a0b16c7374b038be5f740677084e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:26Z,use_quota=True,user_id='89fecc4a518c4844b2beb95ee4e05728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Creating volume 749cd622-5eae-4db5-8782-73b18f065482 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:26 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:26 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 1073741824 Aug 05 16:02:26 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:26 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 1073741824" returned: 0 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:27 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 Aug 05 16:02:27 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:27 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 1.513s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56ce830e-daea-49f1-9fd5-ce8d580862c3_yukr7wzndevstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:02:27 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Converted 112.00 MB image at 73.94 MB/s Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:27 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1G Aug 05 16:02:27 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:27 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eef304-434c-48f1-86fa-39006191b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749cd622-5eae-4db5-8782-73b18f065482', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671213ff-2e3a-4273-b402-2a19fd4d5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Volume volume-749cd622-5eae-4db5-8782-73b18f065482 (749cd622-5eae-4db5-8782-73b18f065482): created successfully Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671213ff-2e3a-4273-b402-2a19fd4d5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Flow 'volume_create_manager' (af420811-cf74-4f11-a7dd-6934d1bace43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2e90203e-67df-4ea5-a488-f8884c76f11d tempest-ProjectReaderTests-27607167 None] Created volume successfully. Aug 05 16:02:27 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe 1G" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9968cc73-7c7a-47e7-92b3-2eb2b3cb8a9c]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:27 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:27 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:27 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:27 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:27 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:28 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 1 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Downloaded image 56ce830e-daea-49f1-9fd5-ce8d580862c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}])) to volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Temporary image 56ce830e-daea-49f1-9fd5-ce8d580862c3 for user b029f70f014f48089c8c39253491685c is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Marking volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Copying metadata from image 56ce830e-daea-49f1-9fd5-ce8d580862c3 to 309038b5-918b-4bc8-bcab-ccf58f6ec3fe. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Creating volume glance metadata for volume 309038b5-918b-4bc8-bcab-ccf58f6ec3fe backed by image 56ce830e-daea-49f1-9fd5-ce8d580862c3 with: {'image_id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'image_name': 'tempest-scenario-img--64321554', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda51df-e620-40e0-a278-3f88e8891f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe', 'volume_size': 1, 'image_id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56ce830e-daea-49f1-9fd5-ce8d580862c3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--64321554', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53620c961bd043cb905698c9106d6c20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '56ce830e-daea-49f1-9fd5-ce8d580862c3', 'created_at': datetime.datetime(2026, 8, 5, 14, 2, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 2, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56ce830e-daea-49f1-9fd5-ce8d580862c3/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c9873f-5e05-47d0-a85f-4b8968e94ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:28 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Volume volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe (309038b5-918b-4bc8-bcab-ccf58f6ec3fe): created successfully Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c9873f-5e05-47d0-a85f-4b8968e94ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Flow 'volume_create_manager' (6ea1462a-0ab7-4a37-ad12-37a32fd872dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3eda0f15-02a5-448c-ae7f-78c7e17a2a15 tempest-TestInstancesWithCinderVolumes-1834772897 None] Created volume successfully. Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-749cd622-5eae-4db5-8782-73b18f065482-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "cinder-749cd622-5eae-4db5-8782-73b18f065482-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Acquiring lock "cinder-quobyte-749cd622-5eae-4db5-8782-73b18f065482" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-749cd622-5eae-4db5-8782-73b18f065482" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc5e69-ca64-4f9a-87c7-6f60945ce6b1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:28 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 Aug 05 16:02:28 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:28 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:28 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482 Aug 05 16:02:28 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:29 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-749cd622-5eae-4db5-8782-73b18f065482" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "cinder-quobyte-749cd622-5eae-4db5-8782-73b18f065482" released by "delete_volume" :: held 0.643s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Created reservations ['b50abd3e-316b-403d-ad05-ce75bd23114a', '0fd9fc5a-bafb-4c84-a795-b4890b4037a3', '31c363c7-52d0-40d4-a232-558dd902709c', 'de75560a-26c3-4ce3-a17a-f97f282108fd'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:29 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:02:29 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:29 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:02:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Deleted volume successfully. Aug 05 16:02:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-75c13ea2-4e6c-4000-9345-37dfbf2d9921 tempest-ProjectReaderTests-27607167 None] Lock "cinder-749cd622-5eae-4db5-8782-73b18f065482-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:02:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf97ba1-e2fa-4e2b-aacf-08e6ace1ab01]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:32 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:32 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:33 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 0.496s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:33 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:02:33 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:33 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 1 in 0.424s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85a34733-4ba4-4ae4-a73e-39a41a969f0f', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:02:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-720fb85c-e941-488a-bae1-273eda5d2abe req-350394be-ddc4-4b9d-9a80-ee1522a194f6 tempest-TestInstancesWithCinderVolumes-1834772897 None] attachment_update completed successfully. Aug 05 16:02:43 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=40,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=6 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:02:43 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=58,cinder:SELECT=50,cinder:DELETE=5,cinder:INSERT=17 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Flow 'volume_create_manager' (3a8f7f30-fd9c-448d-9bc8-281c445f1a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6239132a-3f85-4883-97bd-821823cffc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6239132a-3f85-4883-97bd-821823cffc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1468360584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a214b510b4960971772c8d33f6cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:55Z,use_quota=True,user_id='e737545936db472488eefb8c8b70b0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3725653a-1a0d-4874-8ce8-e65b566a8aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3725653a-1a0d-4874-8ce8-e65b566a8aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824254e-9e98-44bb-931c-2abd4b733447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e824254e-9e98-44bb-931c-2abd4b733447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe', 'volume_name': 'volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8122f8-7195-4aab-b9f0-2cf22a3e0948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8122f8-7195-4aab-b9f0-2cf22a3e0948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9056de-b9be-48e6-9251-c7a3f9d5026f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Volume 8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe', 'volume_size': 1} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1468360584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a214b510b4960971772c8d33f6cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:55Z,use_quota=True,user_id='e737545936db472488eefb8c8b70b0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Creating volume 8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:54 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:02:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:54 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe 1073741824 Aug 05 16:02:54 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:55 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe 1073741824" returned: 0 in 0.441s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:55 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:02:55 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:55 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9056de-b9be-48e6-9251-c7a3f9d5026f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6b759-8768-41ec-baa1-f752e255ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:55 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Volume volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe (8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe): created successfully Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6b759-8768-41ec-baa1-f752e255ac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Flow 'volume_create_manager' (3a8f7f30-fd9c-448d-9bc8-281c445f1a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c27e0054-aa2d-4509-a971-4993254baacb tempest-SnapshotDependencyTests-890165563 None] Created volume successfully. Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Creating offline snapshot 999fcb8e-c96d-426c-9426-5f24262c63e2 of volume 8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efac01-c564-4ecb-9efa-34b7cf961385]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:56 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:02:56 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:56 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:56 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 1G Aug 05 16:02:56 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:56 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 1G" returned: 0 in 0.399s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:56 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:02:56 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:56 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.312s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:57 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 is being set with open permissions: ugo+rw Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:57 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:02:57 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:57 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.239s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:57 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info Aug 05 16:02:57 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:57 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info" returned: 0 in 0.241s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:57 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info is being set with open permissions: ugo+rw Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:57 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info Aug 05 16:02:57 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:57 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.info" returned: 0 in 0.247s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9f473696-726a-4f24-9ff0-b02a97a50ce0 tempest-SnapshotDependencyTests-890165563 None] Create snapshot completed successfully Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Flow 'volume_create_manager' (df48b266-0539-4cb7-b8ca-be9d72ff436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea84e6f9-78ca-4ac1-89d7-ac245bafaf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea84e6f9-78ca-4ac1-89d7-ac245bafaf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3023560f-4f44-4972-831a-874af9d684c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a214b510b4960971772c8d33f6cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=999fcb8e-c96d-426c-9426-5f24262c63e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:02:58Z,use_quota=True,user_id='e737545936db472488eefb8c8b70b0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74c67e7-702b-47ab-9293-546bc3a0154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74c67e7-702b-47ab-9293-546bc3a0154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb91baa-60be-42b3-9d90-a5a2c2764db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb91baa-60be-42b3-9d90-a5a2c2764db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3023560f-4f44-4972-831a-874af9d684c7', 'volume_name': 'volume-3023560f-4f44-4972-831a-874af9d684c7', 'volume_size': 1, 'snapshot_id': '999fcb8e-c96d-426c-9426-5f24262c63e2'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224d046-d492-4980-a7ba-901188a5411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224d046-d492-4980-a7ba-901188a5411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47115b6-d1ae-4fcb-8ee7-3d6db2d67284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:02:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Volume 3023560f-4f44-4972-831a-874af9d684c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3023560f-4f44-4972-831a-874af9d684c7', 'volume_size': 1, 'snapshot_id': '999fcb8e-c96d-426c-9426-5f24262c63e2'} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2-3023560f-4f44-4972-831a-874af9d684c7" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2-3023560f-4f44-4972-831a-874af9d684c7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Creating volume 3023560f-4f44-4972-831a-874af9d684c7 from snapshot 999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] snapshot: 999fcb8e-c96d-426c-9426-5f24262c63e2, volume: 3023560f-4f44-4972-831a-874af9d684c7, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20256d-9831-4aff-89a9-b2dec3170bd3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:58 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:02:58 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:59 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.345s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f415bc-12dc-4600-ba4a-0d186f15f7d9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:59 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:02:59 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:02:59 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.358s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:02:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:02:59 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 Aug 05 16:02:59 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:03 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:03 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:04 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7" returned: 0 in 4.679s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d2644c-4ca2-4b0f-9fb6-f4f0db450a36]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:04 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.440s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:03:04 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:03:04 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:04 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.547s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:03:04 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Converted 1024.00 MB image at 218.76 MB/s Aug 05 16:03:04 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 is being set with open permissions: ugo+rw Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:04 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 Aug 05 16:03:04 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:04 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7" returned: 0 in 0.230s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" released by "_copy_volume_from_snapshot" :: held 6.252s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2-3023560f-4f44-4972-831a-874af9d684c7" released by "_create_volume_from_snapshot" :: held 6.284s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.299s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47115b6-d1ae-4fcb-8ee7-3d6db2d67284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3023560f-4f44-4972-831a-874af9d684c7', 'volume_size': 1, 'snapshot_id': '999fcb8e-c96d-426c-9426-5f24262c63e2'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb047548-7be6-436d-9a15-a1021a2f13f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:03:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Volume volume-3023560f-4f44-4972-831a-874af9d684c7 (3023560f-4f44-4972-831a-874af9d684c7): created successfully Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb047548-7be6-436d-9a15-a1021a2f13f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:03:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Flow 'volume_create_manager' (df48b266-0539-4cb7-b8ca-be9d72ff436c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:03:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1fd86939-9fb1-4c68-9cbb-60cd366b7b8e tempest-SnapshotDependencyTests-890165563 None] Created volume successfully. Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-999fcb8e-c96d-426c-9426-5f24262c63e2-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-999fcb8e-c96d-426c-9426-5f24262c63e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Deleting offline snapshot 999fcb8e-c96d-426c-9426-5f24262c63e2 of volume 8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] snapshot_file for this snap is: volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae382bb1-a493-4bad-af4b-5725edaa019f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:05 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:03:05 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:05 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17226d-e2d2-4a92-8fbf-340006b9ec47]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:05 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:03:05 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:06 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:06 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:03:06 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:06 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:06 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2 Aug 05 16:03:06 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:06 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe.999fcb8e-c96d-426c-9426-5f24262c63e2" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-999fcb8e-c96d-426c-9426-5f24262c63e2" released by "_delete_snapshot" :: held 1.405s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" released by "delete_snapshot" :: held 1.428s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Created reservations ['9d4c6e56-8040-4cc0-aef6-7ae243ae76c1', 'a6f9f3a2-e3c8-4ad7-81e8-69f051cd8082', 'f7cdf731-b083-4752-aad4-fefca8c5bc78', '07538131-6765-4394-ad64-733ad7e0c782'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Delete snapshot completed successfully. Aug 05 16:03:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d3d6a066-db52-4b87-929e-efe3659f6e68 tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-999fcb8e-c96d-426c-9426-5f24262c63e2-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9aab8-4885-4b26-a84d-910ffcc3ae22]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:07 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 Aug 05 16:03:07 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a7fb5-2ffe-41d6-9279-061ba6d7b1ab]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:07 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:03:07 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:07 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.399s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-6fbbe604-0f12-4b57-9538-24df1cd5c869', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19dbf517-e9bc-4f6c-a26a-31e039199960', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:03:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-66340f51-9362-4d5d-8426-32e80a72f4a7 req-60dee164-0c36-4272-a63d-9bc9b14a13b7 tempest-TestInstancesWithCinderVolumes-1834772897 None] attachment_update completed successfully. Aug 05 16:03:07 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.380s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:07 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe Aug 05 16:03:07 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:08 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe" released by "delete_volume" :: held 0.710s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Created reservations ['a908632b-6647-4838-b470-9e7b85ba0467', '4f4ec442-6b56-4d20-a514-f61b14a6e66a', '170a1d17-2d0b-43e6-bbf9-3b1babc5b198', 'a03ff079-ba8b-4fd7-b854-1335638657f2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:08 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:08 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-3023560f-4f44-4972-831a-874af9d684c7-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-3023560f-4f44-4972-831a-874af9d684c7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:08 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.265s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Deleted volume successfully. Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-52f65520-8470-4f20-8365-1c1ac68fdcdd tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-8aaf7966-dcc4-4e7b-9ba3-972d62faa1fe-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf6d4f-e675-4598-a2b3-7897cd608aef]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:08 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 Aug 05 16:03:08 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:08 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:09 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7 Aug 05 16:03:09 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:09 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3023560f-4f44-4972-831a-874af9d684c7" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-quobyte-3023560f-4f44-4972-831a-874af9d684c7" released by "delete_volume" :: held 0.657s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Created reservations ['4f0fbe1a-a588-4daf-b59d-7c1a95110377', '9a19bee3-8fc0-46ec-aa12-b497bb7cfd64', '80c22210-c9cb-44d9-a646-a30881dbc4d1', '603f2271-087a-4b10-be6f-56c63afa6bb9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:09 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:09 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:09 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Deleted volume successfully. Aug 05 16:03:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d19b3e03-31ae-4e35-a3d5-3e8e3f3bfbfa tempest-SnapshotDependencyTests-890165563 None] Lock "cinder-3023560f-4f44-4972-831a-874af9d684c7-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3da128-dd91-479f-bf90-767359d8ca92]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:10 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f Aug 05 16:03:10 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:10 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.418s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45c3c6b8-9d92-4fe4-89ae-779799d5a3e0', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:03:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-6d9d2b36-b35c-4626-8281-08808f713853 req-d7a5fe84-d77b-4c4b-a259-8e5774dbcc1f tempest-TestInstancesWithCinderVolumes-1834772897 None] attachment_update completed successfully. Aug 05 16:03:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-2451ec36-463f-42c5-8d8b-c293310676ad req-bcf77542-b9ef-471b-9ddc-ce2cf61453d9 tempest-TestInstancesWithCinderVolumes-1834772897 None] Terminate volume connection completed successfully. Aug 05 16:03:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-2451ec36-463f-42c5-8d8b-c293310676ad req-bcf77542-b9ef-471b-9ddc-ce2cf61453d9 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleting attachment 19dbf517-e9bc-4f6c-a26a-31e039199960. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:03:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-6fbbe604-0f12-4b57-9538-24df1cd5c869-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-6fbbe604-0f12-4b57-9538-24df1cd5c869-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-quobyte-6fbbe604-0f12-4b57-9538-24df1cd5c869" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-6fbbe604-0f12-4b57-9538-24df1cd5c869" acquired by "delete_volume" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2b1625-f987-4ccb-b4f6-8145ac7bd188]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:17 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 Aug 05 16:03:17 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:17 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:17 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869 Aug 05 16:03:17 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:17 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6fbbe604-0f12-4b57-9538-24df1cd5c869" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-6fbbe604-0f12-4b57-9538-24df1cd5c869" released by "delete_volume" :: held 0.780s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:17 devstack cinder-volume[88715]: WARNING cinder.quota [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805846060-921865120 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805846060-921865120, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:17 devstack cinder-volume[88715]: WARNING cinder.quota [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805846060-921865120 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805846060-921865120, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Created reservations ['b444e364-e0ff-40f3-b04c-d2c879e4d152', '990ae781-5cd3-4512-a24a-748818181d49', 'f717e1d0-3e36-4288-b294-d7088aa16b4e', '044cbc00-d153-4874-8e03-f329177e21d0'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:18 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:18 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:18 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleted volume successfully. Aug 05 16:03:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0f2900c8-cf4f-40c2-a387-db1a1ba84e53 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-6fbbe604-0f12-4b57-9538-24df1cd5c869-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-37a53fd8-a107-4ff1-a86a-a971924ec079 req-fa5a1c09-efa4-404e-a8c6-bd6963ad9193 tempest-TestInstancesWithCinderVolumes-1834772897 None] Terminate volume connection completed successfully. Aug 05 16:03:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-37a53fd8-a107-4ff1-a86a-a971924ec079 req-fa5a1c09-efa4-404e-a8c6-bd6963ad9193 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleting attachment 45c3c6b8-9d92-4fe4-89ae-779799d5a3e0. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-quobyte-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acf8cf0-aa16-4c27-8f75-21fe0e6b0959]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:21 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f Aug 05 16:03:21 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:21 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" returned: 0 in 0.421s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:22 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f Aug 05 16:03:22 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:22 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f" released by "delete_volume" :: held 0.730s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:22 devstack cinder-volume[88715]: WARNING cinder.quota [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1910353660-248863224 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1910353660-248863224, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:22 devstack cinder-volume[88715]: WARNING cinder.quota [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1910353660-248863224 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1910353660-248863224, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Created reservations ['7021b098-3cb1-467f-a4e5-c4a17c60d43a', '03667811-1aad-494c-8481-7b204afc9b8e', 'f97ca261-c369-4f5e-a862-310cc5bc7ddd', '5211fd83-43d6-4d52-adfd-d8c672d14a20'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:22 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:22 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:22 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleted volume successfully. Aug 05 16:03:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d71c455d-bc50-42b4-9277-f6d8a9526f44 tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-a58b95f8-d95e-48ec-8e06-c2a6e7e1d55f-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-55d5029a-6b24-4780-beae-5c19b0928b1a req-148badd4-ce67-4c55-a0a3-d3b80ca80504 tempest-TestInstancesWithCinderVolumes-1834772897 None] Terminate volume connection completed successfully. Aug 05 16:03:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-55d5029a-6b24-4780-beae-5c19b0928b1a req-148badd4-ce67-4c55-a0a3-d3b80ca80504 tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleting attachment 85a34733-4ba4-4ae4-a73e-39a41a969f0f. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-309038b5-918b-4bc8-bcab-ccf58f6ec3fe-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-309038b5-918b-4bc8-bcab-ccf58f6ec3fe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "cinder-quobyte-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[350634ed-29a0-429d-95e9-78928cf97856]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:26 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:03:26 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:26 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 0.359s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:26 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:03:26 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:27 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 1 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:27 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe Aug 05 16:03:27 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:27 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" returned: 0 in 0.242s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-quobyte-309038b5-918b-4bc8-bcab-ccf58f6ec3fe" released by "delete_volume" :: held 0.998s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:27 devstack cinder-volume[88715]: WARNING cinder.quota [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698427325-1339194058 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698427325-1339194058, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:27 devstack cinder-volume[88715]: WARNING cinder.quota [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698427325-1339194058 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-698427325-1339194058, it is now deprecated. Please use the default quota class for default quota. Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Created reservations ['5fb99f15-f1d1-4496-a119-940d02e1770b', '80f8507a-3d6d-42cb-a757-098c9e6b5d12', 'c588cce4-a55a-466e-9d75-b0022b0185a4', 'd3906d54-00cb-48d7-b515-ba6bdef90d45'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:03:27 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:03:27 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:03:27 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.242s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:03:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Deleted volume successfully. Aug 05 16:03:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1162ebe9-092f-4988-8cf5-d4240e50287f tempest-TestInstancesWithCinderVolumes-1834772897 None] Lock "cinder-309038b5-918b-4bc8-bcab-ccf58f6ec3fe-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:03:37 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=62,cinder:SELECT=51,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:03:37 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=48,cinder:DELETE=7 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:03:49 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:03:49 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:03 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:04:03 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:03 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.311s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:04:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:04:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:04:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Flow 'volume_create_manager' (b4f621c1-4321-4684-98f3-0135e567989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbdb55b-c782-43eb-8728-db9d178de7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbdb55b-c782-43eb-8728-db9d178de7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1453539038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8af837-6417-4a17-b6c4-d263e896dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b065c61a344b689d5f62bbdc626574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:04:09Z,use_quota=True,user_id='4b7bfa0af6ff4712a0f1afe5070d5ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296cca71-2d95-4f44-9e2d-dd736de6021c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296cca71-2d95-4f44-9e2d-dd736de6021c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464d4c15-5883-47ef-9afe-f33bb7bfe5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464d4c15-5883-47ef-9afe-f33bb7bfe5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8af837-6417-4a17-b6c4-d263e896dbe6', 'volume_name': 'volume-7c8af837-6417-4a17-b6c4-d263e896dbe6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c0499c-f872-45d5-a826-037161fd7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c0499c-f872-45d5-a826-037161fd7306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3268db0-2b00-488e-8dd8-662ed80afa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:08 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Volume 7c8af837-6417-4a17-b6c4-d263e896dbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8af837-6417-4a17-b6c4-d263e896dbe6', 'volume_size': 1} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1453539038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8af837-6417-4a17-b6c4-d263e896dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7b065c61a344b689d5f62bbdc626574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:04:09Z,use_quota=True,user_id='4b7bfa0af6ff4712a0f1afe5070d5ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Creating volume 7c8af837-6417-4a17-b6c4-d263e896dbe6 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:04:08 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:04:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:08 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 1073741824 Aug 05 16:04:08 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:09 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 1073741824" returned: 0 in 0.433s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:09 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 Aug 05 16:04:09 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:09 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6" returned: 0 in 0.258s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3268db0-2b00-488e-8dd8-662ed80afa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8af837-6417-4a17-b6c4-d263e896dbe6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfbda0-a083-419f-bc49-b57970caa83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:04:09 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Volume volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 (7c8af837-6417-4a17-b6c4-d263e896dbe6): created successfully Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfbda0-a083-419f-bc49-b57970caa83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:04:09 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Flow 'volume_create_manager' (b4f621c1-4321-4684-98f3-0135e567989b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:04:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c5b0049c-6e87-4c3f-8bde-faae6c27bf26 tempest-TestMinimumBasicScenario-1241726028 None] Created volume successfully. Aug 05 16:04:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:04:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:04:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f40c5c-88fd-4449-b53d-2150244156cd]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:04:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:10 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 Aug 05 16:04:10 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:11 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.403s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:04:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0', 'name': 'volume-7c8af837-6417-4a17-b6c4-d263e896dbe6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e654450a-fc4d-4289-90ec-ebf1b6407172', 'enforce_multipath': True} {{(pid=88715) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 16:04:11 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-5125d7dd-165c-42d8-928d-836188fbe19a req-c55de970-d565-43e2-9120-0d24860a674c tempest-TestMinimumBasicScenario-1241726028 None] attachment_update completed successfully. Aug 05 16:04:21 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:04:21 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:04:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [req-21b29fe5-4034-4b8e-9128-ffd6bb18bae2 req-59be63c7-ddda-4830-a821-1ba37711519a tempest-TestMinimumBasicScenario-1241726028 None] Terminate volume connection completed successfully. Aug 05 16:04:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [req-21b29fe5-4034-4b8e-9128-ffd6bb18bae2 req-59be63c7-ddda-4830-a821-1ba37711519a tempest-TestMinimumBasicScenario-1241726028 None] Deleting attachment e654450a-fc4d-4289-90ec-ebf1b6407172. {{(pid=88715) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "cinder-7c8af837-6417-4a17-b6c4-d263e896dbe6-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "cinder-7c8af837-6417-4a17-b6c4-d263e896dbe6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "cinder-quobyte-7c8af837-6417-4a17-b6c4-d263e896dbe6" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "cinder-quobyte-7c8af837-6417-4a17-b6c4-d263e896dbe6" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[88615a75-6119-49dc-84cc-e1e986b6bb1d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:59 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 Aug 05 16:04:59 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:59 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6" returned: 0 in 0.358s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:59 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6 Aug 05 16:04:59 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:04:59 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-7c8af837-6417-4a17-b6c4-d263e896dbe6" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "cinder-quobyte-7c8af837-6417-4a17-b6c4-d263e896dbe6" released by "delete_volume" :: held 0.649s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Created reservations ['fa31ec71-5825-42b3-97fd-73af4a318627', '471d05c4-e882-48f6-aa7d-ef16533e929d', '40150746-e364-4276-aa94-3af3023b72e7', '2da82a1b-1cab-4a5e-9b5a-fb2a7f54d429'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:04:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:04:59 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:04:59 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:00 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:00 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:00 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Deleted volume successfully. Aug 05 16:05:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-02db827a-fb9d-4654-8c3e-87d9c5f983be tempest-TestMinimumBasicScenario-1241726028 None] Lock "cinder-7c8af837-6417-4a17-b6c4-d263e896dbe6-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:03 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:03 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:03 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.247s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:05:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:05:09 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:05:10 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (f4b66113-b23a-40cc-882f-cf417a04b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b442351-76f6-4632-9d8d-bc3074e29426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b442351-76f6-4632-9d8d-bc3074e29426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601147037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeeabbd-9b19-4eb1-b8af-27a89cfc927e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:14Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcc032b-8a5a-4b1f-af94-07c6d87747dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcc032b-8a5a-4b1f-af94-07c6d87747dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1165310d-f84c-4b8b-b743-c06f1ce235db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1165310d-f84c-4b8b-b743-c06f1ce235db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebeeabbd-9b19-4eb1-b8af-27a89cfc927e', 'volume_name': 'volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e1ee52-ccad-4db9-a325-29aef5830f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e1ee52-ccad-4db9-a325-29aef5830f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06c869-3317-441b-9bc9-8144c5a4742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume ebeeabbd-9b19-4eb1-b8af-27a89cfc927e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e', 'volume_size': 1} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601147037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeeabbd-9b19-4eb1-b8af-27a89cfc927e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:14Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume ebeeabbd-9b19-4eb1-b8af-27a89cfc927e {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:13 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:13 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e 1073741824 Aug 05 16:05:13 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:14 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e 1073741824" returned: 0 in 0.421s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:14 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e Aug 05 16:05:14 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:14 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06c869-3317-441b-9bc9-8144c5a4742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e89d2d-4efc-477b-b535-ffda38689424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e (ebeeabbd-9b19-4eb1-b8af-27a89cfc927e): created successfully Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e89d2d-4efc-477b-b535-ffda38689424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (f4b66113-b23a-40cc-882f-cf417a04b255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c9d4c382-db3d-497d-be6d-a8248b5312ae tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (af2806e0-5644-4107-9541-2a3532096f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bcc4e1-885a-4290-b5b9-157074039e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bcc4e1-885a-4290-b5b9-157074039e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797943863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a1fb4e-558e-4f75-bdb0-d41865adcce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:15Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14dbbfa-4436-4a55-b34f-4db779d99c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14dbbfa-4436-4a55-b34f-4db779d99c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96cd6e4-10e3-49b0-a8c0-a51cabea6408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96cd6e4-10e3-49b0-a8c0-a51cabea6408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a1fb4e-558e-4f75-bdb0-d41865adcce2', 'volume_name': 'volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f66bd9-112b-4db1-aa43-7f9a2f57f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f66bd9-112b-4db1-aa43-7f9a2f57f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51190926-c98c-4508-83e1-6a9b4e031a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume 57a1fb4e-558e-4f75-bdb0-d41865adcce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2', 'volume_size': 1} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797943863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a1fb4e-558e-4f75-bdb0-d41865adcce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:15Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume 57a1fb4e-558e-4f75-bdb0-d41865adcce2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:15 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:15 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 1073741824 Aug 05 16:05:15 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (45ee848a-d55f-4b0a-8647-eeefe225bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b65a872-9f96-4a5d-bc55-8c71f8933e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b65a872-9f96-4a5d-bc55-8c71f8933e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405513581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edca38-efeb-4f12-87dc-a112418568ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985af7bd-1fc0-483a-90c4-7a8402f759b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985af7bd-1fc0-483a-90c4-7a8402f759b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7cd6a4-7e7b-4c6c-9819-1e35b2c74299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7cd6a4-7e7b-4c6c-9819-1e35b2c74299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88edca38-efeb-4f12-87dc-a112418568ff', 'volume_name': 'volume-88edca38-efeb-4f12-87dc-a112418568ff', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1a9503-9afe-4ecd-adc6-a37f56bec611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1a9503-9afe-4ecd-adc6-a37f56bec611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6533281-831a-4051-b87d-e1a46392dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume 88edca38-efeb-4f12-87dc-a112418568ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88edca38-efeb-4f12-87dc-a112418568ff', 'volume_size': 1} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:15 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 1073741824" returned: 0 in 0.477s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:15 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 Aug 05 16:05:15 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (9e85afc3-446a-4589-a2c5-a5ba38e7f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0437d630-3dee-404f-84c9-0fe0fcf8dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0437d630-3dee-404f-84c9-0fe0fcf8dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999426885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3c7d7d-ae99-4692-80c0-afef38673bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc89a3f-6152-4ba2-a064-2f016abada50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc89a3f-6152-4ba2-a064-2f016abada50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31eab78-6fba-4727-bac9-da37a0c043bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31eab78-6fba-4727-bac9-da37a0c043bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3c7d7d-ae99-4692-80c0-afef38673bef', 'volume_name': 'volume-3d3c7d7d-ae99-4692-80c0-afef38673bef', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ee58a2-40fa-473c-a4b0-40b538b6f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ee58a2-40fa-473c-a4b0-40b538b6f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce1426d-95b5-4fe3-83c1-8f2c5ad1503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume 3d3c7d7d-ae99-4692-80c0-afef38673bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3c7d7d-ae99-4692-80c0-afef38673bef', 'volume_size': 1} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:16 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2" returned: 0 in 0.281s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1405513581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edca38-efeb-4f12-87dc-a112418568ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume 88edca38-efeb-4f12-87dc-a112418568ff {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51190926-c98c-4508-83e1-6a9b4e031a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff 1073741824 Aug 05 16:05:16 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c156d4-b458-4b3f-b560-ffa453263758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 (57a1fb4e-558e-4f75-bdb0-d41865adcce2): created successfully Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c156d4-b458-4b3f-b560-ffa453263758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (af2806e0-5644-4107-9541-2a3532096f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e92c043e-099f-4989-aeb0-2b70a96e7e8c tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (c6408d60-0ec7-417d-956e-7afded9ff219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffec4b4-7aa3-4d7c-9cdd-b8c7ba958818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffec4b4-7aa3-4d7c-9cdd-b8c7ba958818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334810839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5e19a-b2e9-4d80-808d-c751d169fa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316779ea-d703-4758-9d2e-03991214b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316779ea-d703-4758-9d2e-03991214b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ee765c-cd49-4490-aebf-3b3b6afef6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ee765c-cd49-4490-aebf-3b3b6afef6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d5e19a-b2e9-4d80-808d-c751d169fa23', 'volume_name': 'volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbec104-444d-475c-a8ab-a13d895695dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbec104-444d-475c-a8ab-a13d895695dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f614944c-8f3b-4b12-956d-346d43e01023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume f9d5e19a-b2e9-4d80-808d-c751d169fa23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23', 'volume_size': 1} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:16 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff 1073741824" returned: 0 in 0.453s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:16 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff Aug 05 16:05:16 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (511b5bbb-3345-450f-9c12-4c1593c0f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a3a549-293c-473c-9a73-1e534a3e91f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a3a549-293c-473c-9a73-1e534a3e91f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314594328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5b96a2-22af-4176-843b-dbb55ff66a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:17Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8f3103-acd5-4724-abc0-0e874921275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8f3103-acd5-4724-abc0-0e874921275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27cd31d-e238-4cff-a209-0ddbde3f31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27cd31d-e238-4cff-a209-0ddbde3f31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5b96a2-22af-4176-843b-dbb55ff66a27', 'volume_name': 'volume-9e5b96a2-22af-4176-843b-dbb55ff66a27', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9533dd-7c84-47de-9d3d-134bfaa1a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9533dd-7c84-47de-9d3d-134bfaa1a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329ca43c-6325-46f1-a20d-de0a8ade0d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume 9e5b96a2-22af-4176-843b-dbb55ff66a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5b96a2-22af-4176-843b-dbb55ff66a27', 'volume_size': 1} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:16 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff" returned: 0 in 0.260s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999426885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3c7d7d-ae99-4692-80c0-afef38673bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume 3d3c7d7d-ae99-4692-80c0-afef38673bef {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6533281-831a-4051-b87d-e1a46392dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88edca38-efeb-4f12-87dc-a112418568ff', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747b419e-3757-4116-a951-34bf46fed9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:16 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef 1073741824 Aug 05 16:05:16 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-88edca38-efeb-4f12-87dc-a112418568ff (88edca38-efeb-4f12-87dc-a112418568ff): created successfully Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747b419e-3757-4116-a951-34bf46fed9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (45ee848a-d55f-4b0a-8647-eeefe225bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0f2da2f0-4816-4f97-8b39-7befa6979e2f tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:17 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef 1073741824" returned: 0 in 0.446s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:17 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef Aug 05 16:05:17 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:17 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.227s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334810839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5e19a-b2e9-4d80-808d-c751d169fa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:16Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume f9d5e19a-b2e9-4d80-808d-c751d169fa23 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:17 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce1426d-95b5-4fe3-83c1-8f2c5ad1503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3c7d7d-ae99-4692-80c0-afef38673bef', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:17 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 1073741824 Aug 05 16:05:17 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce72520-0f70-4cb8-a9cf-63d2140c8b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:17 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-3d3c7d7d-ae99-4692-80c0-afef38673bef (3d3c7d7d-ae99-4692-80c0-afef38673bef): created successfully Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce72520-0f70-4cb8-a9cf-63d2140c8b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (9e85afc3-446a-4589-a2c5-a5ba38e7f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a32fbeed-9330-4f5d-874f-ecd5994fc973 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:18 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 1073741824" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:18 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 Aug 05 16:05:18 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:18 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23" returned: 0 in 0.242s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314594328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5b96a2-22af-4176-843b-dbb55ff66a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde04972d19349f3b9a9b1b65d755a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:17Z,use_quota=True,user_id='a47bf71c1ad74d2c868cc6a8ffaaf164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Creating volume 9e5b96a2-22af-4176-843b-dbb55ff66a27 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:18 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f614944c-8f3b-4b12-956d-346d43e01023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:18 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 1073741824 Aug 05 16:05:18 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c7fdc5-6789-420b-9d62-cbc03a28fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:18 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 (f9d5e19a-b2e9-4d80-808d-c751d169fa23): created successfully Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c7fdc5-6789-420b-9d62-cbc03a28fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (c6408d60-0ec7-417d-956e-7afded9ff219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-827d89ce-60a3-41cd-becd-399cd79dfe6e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:18 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 1073741824" returned: 0 in 0.401s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:18 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 Aug 05 16:05:18 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:19 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329ca43c-6325-46f1-a20d-de0a8ade0d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5b96a2-22af-4176-843b-dbb55ff66a27', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c51b4fa-7e4b-4fde-9922-7038906d8cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Volume volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 (9e5b96a2-22af-4176-843b-dbb55ff66a27): created successfully Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c51b4fa-7e4b-4fde-9922-7038906d8cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Flow 'volume_create_manager' (511b5bbb-3345-450f-9c12-4c1593c0f095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-69c6eec1-2263-4b74-9e1e-3e5379a425bb tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created volume successfully. Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-9e5b96a2-22af-4176-843b-dbb55ff66a27-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-9e5b96a2-22af-4176-843b-dbb55ff66a27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-9e5b96a2-22af-4176-843b-dbb55ff66a27" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-9e5b96a2-22af-4176-843b-dbb55ff66a27" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d211d-1e68-410a-8a28-4f7a8e43fae4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:20 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 Aug 05 16:05:20 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:20 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:20 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27 Aug 05 16:05:20 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:20 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9e5b96a2-22af-4176-843b-dbb55ff66a27" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-9e5b96a2-22af-4176-843b-dbb55ff66a27" released by "delete_volume" :: held 0.629s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['693c392f-9b7a-4354-b1c7-4e509da36213', '4c2aca54-e0df-4434-a36e-6b75ea833b94', '51032801-7df6-4eb7-8d51-5a4f0c1ac582', '99ef4979-2595-4681-a483-eaa334b305ff'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:20 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:20 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:21 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-24a9f36f-9a9f-4822-ade7-d67a06aab819 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-9e5b96a2-22af-4176-843b-dbb55ff66a27-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-f9d5e19a-b2e9-4d80-808d-c751d169fa23-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-f9d5e19a-b2e9-4d80-808d-c751d169fa23-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-f9d5e19a-b2e9-4d80-808d-c751d169fa23" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-f9d5e19a-b2e9-4d80-808d-c751d169fa23" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cb4793-e6cd-41f0-891e-aa281d8ee7ce]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:21 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 Aug 05 16:05:21 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:21 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23" returned: 0 in 0.350s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:21 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23 Aug 05 16:05:21 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:21 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-f9d5e19a-b2e9-4d80-808d-c751d169fa23" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-f9d5e19a-b2e9-4d80-808d-c751d169fa23" released by "delete_volume" :: held 0.631s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:21 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['3f23d7d9-f50c-40c2-83b7-4222bbaa9474', '23bdc387-86d4-4bc7-8b45-b7d859467d3e', '01f71b0d-792b-451a-b908-526add4c9ebc', 'e455c406-3a0c-43da-89dc-3081bfaf8eb5'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:22 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:22 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:22 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:22 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad3945ed-077b-4005-a7c5-e4f8a8c29d64 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-f9d5e19a-b2e9-4d80-808d-c751d169fa23-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-3d3c7d7d-ae99-4692-80c0-afef38673bef-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-3d3c7d7d-ae99-4692-80c0-afef38673bef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-3d3c7d7d-ae99-4692-80c0-afef38673bef" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-3d3c7d7d-ae99-4692-80c0-afef38673bef" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[757f973d-f7cd-40b0-9ef9-78ddcd9a86e0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:22 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef Aug 05 16:05:22 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:22 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:22 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef Aug 05 16:05:22 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:23 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-3d3c7d7d-ae99-4692-80c0-afef38673bef" returned: 0 in 0.245s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-3d3c7d7d-ae99-4692-80c0-afef38673bef" released by "delete_volume" :: held 0.624s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['3c14858a-c17f-4140-b8a9-54303d48165e', '35b7fd70-7a1d-442a-937c-0c5648a5f5ef', '48fd09b6-abd5-461c-8926-c61b5ecc25dc', 'f05dd044-e18e-4848-90ba-59457d0daa5c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:23 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:23 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:23 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.245s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-116f5c29-973f-4456-a771-dbf2f0dbfb01 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-3d3c7d7d-ae99-4692-80c0-afef38673bef-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-88edca38-efeb-4f12-87dc-a112418568ff-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-88edca38-efeb-4f12-87dc-a112418568ff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-88edca38-efeb-4f12-87dc-a112418568ff" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-88edca38-efeb-4f12-87dc-a112418568ff" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb52b9f-f24a-414c-9c88-5f894d8d8a31]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:23 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff Aug 05 16:05:23 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:23 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:23 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff Aug 05 16:05:23 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:24 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-88edca38-efeb-4f12-87dc-a112418568ff" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-88edca38-efeb-4f12-87dc-a112418568ff" released by "delete_volume" :: held 0.635s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['c8497069-7b77-4cf0-b89c-a7f9bde4ce53', '0b8d292e-d472-48a4-b3b8-c81b409c058b', 'beee25be-a8cb-44a4-ba9f-fc57fe6c5b77', '1f04044c-198c-43ef-900f-67f94f3cc2ae'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:24 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:24 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:24 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.236s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:24 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a822ecff-dfd3-4567-9c3d-f88a062f2785 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-88edca38-efeb-4f12-87dc-a112418568ff-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-57a1fb4e-558e-4f75-bdb0-d41865adcce2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-57a1fb4e-558e-4f75-bdb0-d41865adcce2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-57a1fb4e-558e-4f75-bdb0-d41865adcce2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-57a1fb4e-558e-4f75-bdb0-d41865adcce2" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3878e15-28a9-42a1-8b54-01033b220c49]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:24 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 Aug 05 16:05:24 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:25 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:25 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2 Aug 05 16:05:25 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:25 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-57a1fb4e-558e-4f75-bdb0-d41865adcce2" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-57a1fb4e-558e-4f75-bdb0-d41865adcce2" released by "delete_volume" :: held 0.625s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['ab453edf-6639-40e1-8b4c-12c9c498b1de', 'e2ff13c9-5053-4280-b05b-bd842ea34ede', 'b3cb56a9-26cd-456d-895b-2c4ae96f1e61', '88a5e520-0e6d-4060-92e7-2490d5bab9ef'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:25 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:25 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:25 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0d33d75-3087-440a-abdb-53f8256fa883 tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-57a1fb4e-558e-4f75-bdb0-d41865adcce2-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "cinder-quobyte-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd698591-72e9-42f6-b276-47ee07e31190]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:26 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e Aug 05 16:05:26 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:26 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:26 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e Aug 05 16:05:26 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:26 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-quobyte-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e" released by "delete_volume" :: held 0.638s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Created reservations ['a1e72bed-7f6e-416e-b1e8-b8e17597dec9', 'c24ce0d4-dbe3-45f8-b301-96be7885b2a5', '9c8be7d0-f888-4098-abd0-c8a89f52674b', '28851876-f66f-40ec-9e43-004a996617f1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:26 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:26 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:26 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.236s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Deleted volume successfully. Aug 05 16:05:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-79df5b68-5ae0-47e7-a2db-f16fb853813e tempest-CreateVolumesFromSourceVolumeTest-1425588212 None] Lock "cinder-ebeeabbd-9b19-4eb1-b8af-27a89cfc927e-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Flow 'volume_create_manager' (e8bd93bf-7919-4abc-a20d-56ade8862f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829605eb-382f-474d-901e-99ec80c53d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829605eb-382f-474d-901e-99ec80c53d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-320072591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27ee5db-a922-4932-866e-edd094109c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886b1ea4d3044e5c89d8519c5d384231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:29Z,use_quota=True,user_id='7447f16de79443139ecab086f1cfb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc41daf6-6dd2-46e9-8251-2d10d626ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc41daf6-6dd2-46e9-8251-2d10d626ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc00af-490a-4ba7-8b99-42ebaaa30761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc00af-490a-4ba7-8b99-42ebaaa30761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27ee5db-a922-4932-866e-edd094109c70', 'volume_name': 'volume-a27ee5db-a922-4932-866e-edd094109c70', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5e7247-2221-4450-90b8-86c454f61c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5e7247-2221-4450-90b8-86c454f61c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ceb2f0-d70b-4cd8-a62b-4dc11c1170d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:29 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Volume a27ee5db-a922-4932-866e-edd094109c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27ee5db-a922-4932-866e-edd094109c70', 'volume_size': 1} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-320072591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27ee5db-a922-4932-866e-edd094109c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886b1ea4d3044e5c89d8519c5d384231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:29Z,use_quota=True,user_id='7447f16de79443139ecab086f1cfb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Creating volume a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:29 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:29 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 1073741824 Aug 05 16:05:29 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:30 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 1073741824" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:30 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:30 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:30 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ceb2f0-d70b-4cd8-a62b-4dc11c1170d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27ee5db-a922-4932-866e-edd094109c70', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4e7c96-9752-4f61-816e-f0db3746519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Volume volume-a27ee5db-a922-4932-866e-edd094109c70 (a27ee5db-a922-4932-866e-edd094109c70): created successfully Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4e7c96-9752-4f61-816e-f0db3746519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Flow 'volume_create_manager' (e8bd93bf-7919-4abc-a20d-56ade8862f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5fab74b4-9a7e-4cd9-a434-4f7e7154ebb2 tempest-VolumeDependencyTests-868877957 None] Created volume successfully. Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Creating offline snapshot 126b6fa2-1024-499c-b047-c6bd3bdbda38 of volume a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0104f0f-4070-4b55-991b-846a19197ede]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:30 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:30 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:31 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:31 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 1G Aug 05 16:05:31 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:31 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 1G" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27ee5db-a922-4932-866e-edd094109c70 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:31 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27ee5db-a922-4932-866e-edd094109c70 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:31 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:31 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27ee5db-a922-4932-866e-edd094109c70 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:31 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 is being set with open permissions: ugo+rw Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:31 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:31 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:31 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.242s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:32 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info Aug 05 16:05:32 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:32 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:32 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info is being set with open permissions: ugo+rw Aug 05 16:05:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:32 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info Aug 05 16:05:32 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:32 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.info" returned: 0 in 0.245s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:32 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-eadf6037-ec4b-4c92-b75f-355f8d43f7d0 tempest-VolumeDependencyTests-868877957 None] Create snapshot completed successfully Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Flow 'volume_create_manager' (896f1ae2-70e4-4097-8156-c7a1af8d2199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4bb82d-9e53-46a5-a2dc-d7cf64ca22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4bb82d-9e53-46a5-a2dc-d7cf64ca22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2043774529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d129a7-8191-43ab-a976-f439f4e58da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886b1ea4d3044e5c89d8519c5d384231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=126b6fa2-1024-499c-b047-c6bd3bdbda38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:33Z,use_quota=True,user_id='7447f16de79443139ecab086f1cfb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823d247e-c2bb-448b-a546-e00525266137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823d247e-c2bb-448b-a546-e00525266137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41878a78-11b4-4433-9fb2-a8e3ba1bf524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41878a78-11b4-4433-9fb2-a8e3ba1bf524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9d129a7-8191-43ab-a976-f439f4e58da0', 'volume_name': 'volume-d9d129a7-8191-43ab-a976-f439f4e58da0', 'volume_size': 1, 'snapshot_id': '126b6fa2-1024-499c-b047-c6bd3bdbda38'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08c08d2-da90-46d5-b021-739a912dadf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08c08d2-da90-46d5-b021-739a912dadf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d595a2d0-13e1-410c-adcf-14c663e66e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Volume d9d129a7-8191-43ab-a976-f439f4e58da0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9d129a7-8191-43ab-a976-f439f4e58da0', 'volume_size': 1, 'snapshot_id': '126b6fa2-1024-499c-b047-c6bd3bdbda38'} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38-d9d129a7-8191-43ab-a976-f439f4e58da0" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38-d9d129a7-8191-43ab-a976-f439f4e58da0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Creating volume d9d129a7-8191-43ab-a976-f439f4e58da0 from snapshot 126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] snapshot: 126b6fa2-1024-499c-b047-c6bd3bdbda38, volume: d9d129a7-8191-43ab-a976-f439f4e58da0, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f33032-9e40-4ecf-9f40-e1db8d7bb773]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:33 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:33 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:33 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.353s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27ee5db-a922-4932-866e-edd094109c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0462e53-c920-44ae-8cf4-bd2cf4b706f5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:33 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:33 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:34 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.363s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:34 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:05:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:34 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 Aug 05 16:05:34 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:38 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0" returned: 0 in 4.139s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c6ecae-5bd3-4452-8ed4-e250afe715c2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:38 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:38 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:38 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:05:38 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Converted 1024.00 MB image at 247.27 MB/s Aug 05 16:05:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 is being set with open permissions: ugo+rw Aug 05 16:05:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:38 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 Aug 05 16:05:38 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:39 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" released by "_copy_volume_from_snapshot" :: held 5.730s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38-d9d129a7-8191-43ab-a976-f439f4e58da0" released by "_create_volume_from_snapshot" :: held 5.765s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.782s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d595a2d0-13e1-410c-adcf-14c663e66e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d129a7-8191-43ab-a976-f439f4e58da0', 'volume_size': 1, 'snapshot_id': '126b6fa2-1024-499c-b047-c6bd3bdbda38'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd32888-dcfc-44fb-bb37-b250da3483bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:39 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Volume volume-d9d129a7-8191-43ab-a976-f439f4e58da0 (d9d129a7-8191-43ab-a976-f439f4e58da0): created successfully Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd32888-dcfc-44fb-bb37-b250da3483bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Flow 'volume_create_manager' (896f1ae2-70e4-4097-8156-c7a1af8d2199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-34869c8c-e4e7-4297-8006-102be02b3019 tempest-VolumeDependencyTests-868877957 None] Created volume successfully. Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-126b6fa2-1024-499c-b047-c6bd3bdbda38-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-126b6fa2-1024-499c-b047-c6bd3bdbda38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Deleting offline snapshot 126b6fa2-1024-499c-b047-c6bd3bdbda38 of volume a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] snapshot_file for this snap is: volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fe27e-e222-4a07-8a9b-41c4b9ad1c21]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:39 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:39 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:40 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27ee5db-a922-4932-866e-edd094109c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4d02ce-7894-4b62-aa65-5eadbc5343f0]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:40 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:40 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:40 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:40 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:40 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:40 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.325s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:40 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38 Aug 05 16:05:40 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:41 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70.126b6fa2-1024-499c-b047-c6bd3bdbda38" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-126b6fa2-1024-499c-b047-c6bd3bdbda38" released by "_delete_snapshot" :: held 1.373s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" released by "delete_snapshot" :: held 1.394s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Created reservations ['8cb077f2-dbd4-4f51-8ca0-56368e10dd5f', '30867241-4a63-4223-878b-7b222e61d473', '0b3cf0eb-9cef-4fb6-a80d-f7bc9f16eb82', '9ae018e5-a247-426d-a627-308fc7f3b69b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Delete snapshot completed successfully. Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-db1f718a-af96-4e9b-aba5-f2ab691ae097 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-126b6fa2-1024-499c-b047-c6bd3bdbda38-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-a27ee5db-a922-4932-866e-edd094109c70-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-a27ee5db-a922-4932-866e-edd094109c70-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[548f376b-3d28-4990-84db-221b7fe2b51e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:42 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:42 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:42 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:42 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70 Aug 05 16:05:42 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:42 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-a27ee5db-a922-4932-866e-edd094109c70" returned: 0 in 0.241s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-a27ee5db-a922-4932-866e-edd094109c70" released by "delete_volume" :: held 0.660s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Created reservations ['216fe49c-d9f1-406d-8375-dfc2e4516cd7', 'e6787d36-afcd-46f2-8b5d-199caa813094', '3e50bd78-fe14-4e6a-ac1f-22f2f8ac2d6f', '6d5d9ea6-269e-479b-9ff7-b762a6c3e8a2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:42 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:42 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:43 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Deleted volume successfully. Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-91d33304-69ee-440f-bc02-4fef54c78433 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-a27ee5db-a922-4932-866e-edd094109c70-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-d9d129a7-8191-43ab-a976-f439f4e58da0-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-d9d129a7-8191-43ab-a976-f439f4e58da0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2234fd0-ec1f-4c54-ae6c-4a08e853cc86]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:43 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 Aug 05 16:05:43 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:43 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:43 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0 Aug 05 16:05:43 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:43 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-d9d129a7-8191-43ab-a976-f439f4e58da0" returned: 0 in 0.236s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-quobyte-d9d129a7-8191-43ab-a976-f439f4e58da0" released by "delete_volume" :: held 0.623s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Created reservations ['896a4412-9a6c-4773-af57-b9389d69108f', 'b4621541-41ad-41d3-9731-7b51bac4b417', '41a53ccd-c5d2-4a74-9f24-aa34ea5b4553', 'fc44d34c-331a-4f7f-911d-629cdae3ef11'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:43 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:05:43 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:44 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:44 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:05:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Deleted volume successfully. Aug 05 16:05:44 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93bf2222-7163-484e-982e-e1a475c909d9 tempest-VolumeDependencyTests-868877957 None] Lock "cinder-d9d129a7-8191-43ab-a976-f439f4e58da0-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:05:53 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=94,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=9 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:05:54 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=62,cinder:UPDATE=95,cinder:DELETE=8,cinder:INSERT=21 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (808528e6-64b9-4718-9fc1-52eff42c7f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f231f770-1680-47fe-b2aa-748577a5c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f231f770-1680-47fe-b2aa-748577a5c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664423492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774d6b44-d5cf-475c-9d4c-5c34b1cc3acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:56Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d98fc-c29a-4b98-936e-8f3f9f9f55c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95d98fc-c29a-4b98-936e-8f3f9f9f55c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1217fb3-10c9-4e7c-9e88-42323a2ef1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1217fb3-10c9-4e7c-9e88-42323a2ef1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774d6b44-d5cf-475c-9d4c-5c34b1cc3acd', 'volume_name': 'volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86702095-1146-48b2-892c-a7914a1bdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86702095-1146-48b2-892c-a7914a1bdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29df6c59-a695-4b20-bad8-1dcd73663ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume 774d6b44-d5cf-475c-9d4c-5c34b1cc3acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd', 'volume_size': 1} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664423492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774d6b44-d5cf-475c-9d4c-5c34b1cc3acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:56Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume 774d6b44-d5cf-475c-9d4c-5c34b1cc3acd {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:56 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd 1073741824 Aug 05 16:05:56 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e4990c87-4f9b-443e-b41e-229f1abc5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70c8f4-b0e3-4d9f-85ac-af82043b5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70c8f4-b0e3-4d9f-85ac-af82043b5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380499294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbf2c12-b84d-447a-9e84-9e095fe80c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:56Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a360a5b1-ae50-40e9-940a-b23c298fcdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a360a5b1-ae50-40e9-940a-b23c298fcdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ab8e72-37ad-48f5-ad5c-a4b9d0e9d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ab8e72-37ad-48f5-ad5c-a4b9d0e9d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbf2c12-b84d-447a-9e84-9e095fe80c77', 'volume_name': 'volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1b93-d0db-4c60-b945-afc5d005b83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1b93-d0db-4c60-b945-afc5d005b83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff771fd-0180-4a27-a6f2-1fb11f3a86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Volume 6bbf2c12-b84d-447a-9e84-9e095fe80c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77', 'volume_size': 1} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e9ea3a65-f50e-404e-bd4c-0da52a4c9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5038ef8d-983f-48c2-8eda-fca227f2973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5038ef8d-983f-48c2-8eda-fca227f2973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915025882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caffa32-af75-4f28-820f-a269de5c8aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c31f2a-a5f2-4222-a74a-eb9433de0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c31f2a-a5f2-4222-a74a-eb9433de0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e715f5-8df1-4819-a3e8-91fa8dede432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e715f5-8df1-4819-a3e8-91fa8dede432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caffa32-af75-4f28-820f-a269de5c8aae', 'volume_name': 'volume-0caffa32-af75-4f28-820f-a269de5c8aae', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4801c29-674f-4b9f-b703-98d1d7e25434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4801c29-674f-4b9f-b703-98d1d7e25434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28df24b3-930f-48a4-b30b-122d4fb3d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Volume 0caffa32-af75-4f28-820f-a269de5c8aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caffa32-af75-4f28-820f-a269de5c8aae', 'volume_size': 1} Aug 05 16:05:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:57 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd 1073741824" returned: 0 in 0.732s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (dbaeb784-f352-4ef8-ba53-b372796e331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:57 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd Aug 05 16:05:57 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fe5fee-3823-42cd-964c-565afc867f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fe5fee-3823-42cd-964c-565afc867f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663196762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1294abdc-08fc-408d-b61a-c3ae4cad0c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31a3770-e91e-4bb7-9004-f568dab18693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31a3770-e91e-4bb7-9004-f568dab18693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9220278f-055a-4e41-a3d4-d4ba3761ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9220278f-055a-4e41-a3d4-d4ba3761ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1294abdc-08fc-408d-b61a-c3ae4cad0c41', 'volume_name': 'volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1b654b-5169-49df-9b4c-bb334a59e389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1b654b-5169-49df-9b4c-bb334a59e389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36408dc7-4eda-4cdc-9662-80c66242d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume 1294abdc-08fc-408d-b61a-c3ae4cad0c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41', 'volume_size': 1} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e8f90b26-f9c7-42dc-8a0d-26ec364f3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d8a492-e651-4726-804d-987335fa4505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d8a492-e651-4726-804d-987335fa4505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571472216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d44d89d-a52b-439c-a567-791075e6584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d44d89d-a52b-439c-a567-791075e6584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4544cd16-db40-4df3-8c5d-a0fb19ad282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4544cd16-db40-4df3-8c5d-a0fb19ad282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938', 'volume_name': 'volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ced44e-6188-49ad-a69a-5a503ac5d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ced44e-6188-49ad-a69a-5a503ac5d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e5b2f7-e873-42aa-abe6-d75d56a402d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Volume aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938', 'volume_size': 1} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:57 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380499294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbf2c12-b84d-447a-9e84-9e095fe80c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:56Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Creating volume 6bbf2c12-b84d-447a-9e84-9e095fe80c77 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:57 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:57 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 1073741824 Aug 05 16:05:57 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29df6c59-a695-4b20-bad8-1dcd73663ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082202d-6848-4cac-8487-4910df01dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd (774d6b44-d5cf-475c-9d4c-5c34b1cc3acd): created successfully Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f082202d-6848-4cac-8487-4910df01dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (808528e6-64b9-4718-9fc1-52eff42c7f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7b830829-f9ee-43e2-a878-78dc0815955d tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:05:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (64d5fac0-8f35-4b9d-b06b-e743fc8c4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19190d2a-bb65-4308-9b3d-7ca582b1537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19190d2a-bb65-4308-9b3d-7ca582b1537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812779172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99655fc1-2cc6-430d-ba9a-95f232f683b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:58Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3a855-e65a-4642-b7cd-13f8816e7979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3a855-e65a-4642-b7cd-13f8816e7979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a5203d-db0d-4f8a-a396-fcd5e7511bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a5203d-db0d-4f8a-a396-fcd5e7511bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99655fc1-2cc6-430d-ba9a-95f232f683b8', 'volume_name': 'volume-99655fc1-2cc6-430d-ba9a-95f232f683b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5189a1a-6308-42c7-b631-49c293800579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5189a1a-6308-42c7-b631-49c293800579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe237e6a-44ca-4ab7-9328-c7d954727c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Volume 99655fc1-2cc6-430d-ba9a-95f232f683b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99655fc1-2cc6-430d-ba9a-95f232f683b8', 'volume_size': 1} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (64e9ca00-7f78-4882-9b2e-ed1c8dcf36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580b5161-2ae3-4b91-8c3b-932d4ba0ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580b5161-2ae3-4b91-8c3b-932d4ba0ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429850019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397d61f2-9a62-4078-b7b6-b4ebbd020bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:58Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d554842-0b64-482d-8ca2-6db1e6c59b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d554842-0b64-482d-8ca2-6db1e6c59b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6876cd2f-e1d0-4fe4-95e9-1355ed336c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6876cd2f-e1d0-4fe4-95e9-1355ed336c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397d61f2-9a62-4078-b7b6-b4ebbd020bdd', 'volume_name': 'volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2202daac-abad-475a-ad72-e2f98c601338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2202daac-abad-475a-ad72-e2f98c601338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b791dd9-3b0b-4ec8-a1ed-d26004a451be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Volume 397d61f2-9a62-4078-b7b6-b4ebbd020bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd', 'volume_size': 1} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:58 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 1073741824" returned: 0 in 0.667s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:58 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 Aug 05 16:05:58 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:58 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77" returned: 0 in 0.316s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915025882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caffa32-af75-4f28-820f-a269de5c8aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Creating volume 0caffa32-af75-4f28-820f-a269de5c8aae {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:58 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:58 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae 1073741824 Aug 05 16:05:58 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff771fd-0180-4a27-a6f2-1fb11f3a86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39660645-3c4b-48fa-b5c2-e9bbeac70065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Volume volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 (6bbf2c12-b84d-447a-9e84-9e095fe80c77): created successfully Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39660645-3c4b-48fa-b5c2-e9bbeac70065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e4990c87-4f9b-443e-b41e-229f1abc5143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (f19b0138-93c4-4ba7-8aa6-30fd0dc5fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9912d-2f07-446d-8728-26afac361dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d889d1e3-fc1b-41d8-b7b9-e6c7939d6dcf tempest-CreateVolumesFromImageTest-749374805 None] Created volume successfully. Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc9912d-2f07-446d-8728-26afac361dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198069921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597011b4-2003-4317-a55c-b9051376d9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:59Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a375477-5f6d-4f3d-960b-05bb6d7a0555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a375477-5f6d-4f3d-960b-05bb6d7a0555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0abde-6171-4957-b53d-a93acb84216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b0abde-6171-4957-b53d-a93acb84216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597011b4-2003-4317-a55c-b9051376d9af', 'volume_name': 'volume-597011b4-2003-4317-a55c-b9051376d9af', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f61efb-cf63-408f-b1e1-bfea306c3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f61efb-cf63-408f-b1e1-bfea306c3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea7f8d4-eb15-4292-8aa8-9c233b25eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume 597011b4-2003-4317-a55c-b9051376d9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597011b4-2003-4317-a55c-b9051376d9af', 'volume_size': 1} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (4fd7b9f3-8201-4cfe-ae47-90a981efc18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56be6b1-5be7-4e64-9ff0-14753262c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56be6b1-5be7-4e64-9ff0-14753262c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080036885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891899fe-72c9-45c0-807f-e2cbb9648349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:59Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338fe889-5b38-4321-ba2f-6c35fa599b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338fe889-5b38-4321-ba2f-6c35fa599b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc24c6a5-58bd-46fa-9fb1-a00dc29f6334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc24c6a5-58bd-46fa-9fb1-a00dc29f6334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891899fe-72c9-45c0-807f-e2cbb9648349', 'volume_name': 'volume-891899fe-72c9-45c0-807f-e2cbb9648349', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707c8562-2e99-4d24-b12b-8b6a927b8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707c8562-2e99-4d24-b12b-8b6a927b8010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8392502b-8850-4296-8683-807fe1916361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:05:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume 891899fe-72c9-45c0-807f-e2cbb9648349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891899fe-72c9-45c0-807f-e2cbb9648349', 'volume_size': 1} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:59 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae 1073741824" returned: 0 in 0.745s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:05:59 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae Aug 05 16:05:59 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:05:59 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae" returned: 0 in 0.345s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663196762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1294abdc-08fc-408d-b61a-c3ae4cad0c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume 1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:05:59 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:05:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28df24b3-930f-48a4-b30b-122d4fb3d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caffa32-af75-4f28-820f-a269de5c8aae', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb86103-e5ce-4d8e-b898-9d2156c5fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 1073741824 Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:00 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (63487d05-f9a6-4e86-bb37-8b84b08f8a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8246be-b2c4-4fcc-91bc-575c8fa52678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8246be-b2c4-4fcc-91bc-575c8fa52678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1725984600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e045cc6b-dae5-4193-b56d-957b1d564829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:00Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b15d66-a69b-4745-89d4-6d8ceac9458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b15d66-a69b-4745-89d4-6d8ceac9458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f796e2-18e7-4658-8b7f-9ae85a28a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f796e2-18e7-4658-8b7f-9ae85a28a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e045cc6b-dae5-4193-b56d-957b1d564829', 'volume_name': 'volume-e045cc6b-dae5-4193-b56d-957b1d564829', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab94ea3-c3fa-4749-b7df-146814b41b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab94ea3-c3fa-4749-b7df-146814b41b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2d4a0d-4a24-4c39-b943-19afaa176aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume e045cc6b-dae5-4193-b56d-957b1d564829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e045cc6b-dae5-4193-b56d-957b1d564829', 'volume_size': 1} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Volume volume-0caffa32-af75-4f28-820f-a269de5c8aae (0caffa32-af75-4f28-820f-a269de5c8aae): created successfully Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb86103-e5ce-4d8e-b898-9d2156c5fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e9ea3a65-f50e-404e-bd4c-0da52a4c9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:00 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c02e3327-d1a9-4d4b-b77b-51636992a3a9 tempest-CreateVolumesFromImageTest-749374805 None] Created volume successfully. Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (c56778f5-7c77-418d-abc5-10f38e88a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131e5e77-8a4c-4e62-acd0-1480f03cc030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131e5e77-8a4c-4e62-acd0-1480f03cc030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153045263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4743826-b0ca-48fc-b6c3-54eb3221d84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:00Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a1ad62-b2ab-4801-b03e-e10a4298ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a1ad62-b2ab-4801-b03e-e10a4298ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9fb880-d867-46d8-9fe5-bfd451110b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9fb880-d867-46d8-9fe5-bfd451110b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4743826-b0ca-48fc-b6c3-54eb3221d84e', 'volume_name': 'volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a541bc7-8c95-49e1-b34e-ab64f37c9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a541bc7-8c95-49e1-b34e-ab64f37c9f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f0ccd9-4f45-4ffb-a6b0-2c1b36ce6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume e4743826-b0ca-48fc-b6c3-54eb3221d84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e', 'volume_size': 1} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:00 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 1073741824" returned: 0 in 0.660s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:00 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 Aug 05 16:06:00 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (a358f31b-7f49-4d88-958c-b3a033922b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007797cd-0487-401b-8688-31d8110f3754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:00 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007797cd-0487-401b-8688-31d8110f3754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825627099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f19790-baf1-430a-8e41-6d99f3712ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:01Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248b32a6-4c5e-4aa7-9e00-b83b3efe01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248b32a6-4c5e-4aa7-9e00-b83b3efe01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4a5568-ca91-43cf-a4e4-68243c9e0d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4a5568-ca91-43cf-a4e4-68243c9e0d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f19790-baf1-430a-8e41-6d99f3712ee2', 'volume_name': 'volume-c4f19790-baf1-430a-8e41-6d99f3712ee2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae43d036-6bb0-4297-bd84-7692714b3af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae43d036-6bb0-4297-bd84-7692714b3af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2041a1e9-01d8-4118-8744-4645aa7f560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume c4f19790-baf1-430a-8e41-6d99f3712ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f19790-baf1-430a-8e41-6d99f3712ee2', 'volume_size': 1} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571472216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:57Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Creating volume aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36408dc7-4eda-4cdc-9662-80c66242d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6377e73-6087-4bee-9975-c6ac89b56a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 1073741824 Aug 05 16:06:01 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 (1294abdc-08fc-408d-b61a-c3ae4cad0c41): created successfully Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6377e73-6087-4bee-9975-c6ac89b56a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (dbaeb784-f352-4ef8-ba53-b372796e331e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Flow 'volume_create_manager' (17a7825a-08ce-481e-9aeb-22fa5fb48b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd69a7-0174-4b33-991d-abdb3041136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2c05b900-2273-433d-b014-9cd3d870c278 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd69a7-0174-4b33-991d-abdb3041136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1c8877-2c71-422f-97b9-57f6de6d2b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73f50fc2d8f430e9ee4b08ca7697b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:01Z,use_quota=True,user_id='4a6bf95301ac4bd1920924997e5730fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(673fdae3-38aa-406a-bf4f-8fd08999cd7e),volume_type_id=673fdae3-38aa-406a-bf4f-8fd08999cd7e)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fc3351-2323-416b-bb63-6339887a1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fc3351-2323-416b-bb63-6339887a1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9b742b-6b8e-48ed-8303-45701fcceac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9b742b-6b8e-48ed-8303-45701fcceac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb1c8877-2c71-422f-97b9-57f6de6d2b70', 'volume_name': 'volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70', 'volume_size': 1, 'image_id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f41de703f7438e62799bc400810418', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f73f50fc2d8f430e9ee4b08ca7697b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e341574266441625fe6df840ae84bd607d9d470806695623a96fce91f0c39a04fe17d2d19a7073a908ba292d79a2ef75556b714d28e6c5077576bf364a831628', 'id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'created_at': datetime.datetime(2026, 8, 5, 14, 5, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a2dff-51ff-48fb-a210-b2669b767447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a2dff-51ff-48fb-a210-b2669b767447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311b57eb-432f-4c75-9bcf-1498f2ce1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Volume cb1c8877-2c71-422f-97b9-57f6de6d2b70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70', 'volume_size': 1, 'image_id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f41de703f7438e62799bc400810418', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f73f50fc2d8f430e9ee4b08ca7697b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e341574266441625fe6df840ae84bd607d9d470806695623a96fce91f0c39a04fe17d2d19a7073a908ba292d79a2ef75556b714d28e6c5077576bf364a831628', 'id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'created_at': datetime.datetime(2026, 8, 5, 14, 5, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Trying to clone cb1c8877-2c71-422f-97b9-57f6de6d2b70 from image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 16:06:01 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 1073741824" returned: 0 in 0.509s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Image download 0.00 MB at 0.00 MB/s Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:01 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 Aug 05 16:06:01 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3fb0e-fd6d-48a5-b88f-73db6a502552]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:01 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:01 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:01 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.768s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812779172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99655fc1-2cc6-430d-ba9a-95f232f683b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:58Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Creating volume 99655fc1-2cc6-430d-ba9a-95f232f683b8 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e5b2f7-e873-42aa-abe6-d75d56a402d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 1073741824 Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611bfa3a-fd03-4192-83e2-550f599b352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:01 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Volume volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 (aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938): created successfully Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611bfa3a-fd03-4192-83e2-550f599b352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:01 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (e8f90b26-f9c7-42dc-8a0d-26ec364f3b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fda6ee15-2465-4586-af55-d86b49f5b611 tempest-CreateVolumesFromImageTest-749374805 None] Created volume successfully. Aug 05 16:06:02 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:02 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:02 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:02 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 1073741824" returned: 0 in 0.430s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:02 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Temporary image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b is fetched for user 4a6bf95301ac4bd1920924997e5730fd. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 16:06:02 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 Aug 05 16:06:02 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b90d4af-f109-47e4-b84d-7fb1441e0c07]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:02 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:02 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:02 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.185s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429850019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397d61f2-9a62-4078-b7b6-b4ebbd020bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12784e1445ad4be9950524ce87cc7cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:58Z,use_quota=True,user_id='1f89e11daed046f3aa7fce55c6f44ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Creating volume 397d61f2-9a62-4078-b7b6-b4ebbd020bdd {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:02 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:02 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd 1073741824 Aug 05 16:06:02 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe237e6a-44ca-4ab7-9328-c7d954727c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99655fc1-2cc6-430d-ba9a-95f232f683b8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a6d74f-d33d-45ca-ac3f-df389472ba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:02 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Volume volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 (99655fc1-2cc6-430d-ba9a-95f232f683b8): created successfully Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a6d74f-d33d-45ca-ac3f-df389472ba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (64d5fac0-8f35-4b9d-b06b-e743fc8c4533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a18046fb-0e17-4965-ab88-40e775fdb95d tempest-CreateVolumesFromImageTest-749374805 None] Created volume successfully. Aug 05 16:06:02 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:02 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:02 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:03 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd 1073741824" returned: 0 in 0.500s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:03 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:03 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd Aug 05 16:06:03 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:03 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.240s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198069921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597011b4-2003-4317-a55c-b9051376d9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:59Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume 597011b4-2003-4317-a55c-b9051376d9af {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:03 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b791dd9-3b0b-4ec8-a1ed-d26004a451be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:03 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af 1073741824 Aug 05 16:06:03 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9820c2f5-20aa-493b-98ee-f0a06d16d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:03 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Volume volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd (397d61f2-9a62-4078-b7b6-b4ebbd020bdd): created successfully Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9820c2f5-20aa-493b-98ee-f0a06d16d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Flow 'volume_create_manager' (64e9ca00-7f78-4882-9b2e-ed1c8dcf36aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1fad20e9-b904-4087-b294-93adc1bca245 tempest-CreateVolumesFromImageTest-749374805 None] Created volume successfully. Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:03 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:03 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:03 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af 1073741824" returned: 0 in 0.460s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:03 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af Aug 05 16:06:03 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:03 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:06:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:06:04 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af" returned: 0 in 0.271s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.701s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080036885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891899fe-72c9-45c0-807f-e2cbb9648349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:05:59Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume 891899fe-72c9-45c0-807f-e2cbb9648349 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:04 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea7f8d4-eb15-4292-8aa8-9c233b25eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597011b4-2003-4317-a55c-b9051376d9af', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:04 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 1073741824 Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f28d2a-a663-4717-b339-0930458ec955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:04 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:04 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-597011b4-2003-4317-a55c-b9051376d9af (597011b4-2003-4317-a55c-b9051376d9af): created successfully Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f28d2a-a663-4717-b339-0930458ec955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (f19b0138-93c4-4ba7-8aa6-30fd0dc5fac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-397d61f2-9a62-4078-b7b6-b4ebbd020bdd-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e196d3ee-a176-4c4f-9c5b-caa0523c3685 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-397d61f2-9a62-4078-b7b6-b4ebbd020bdd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-quobyte-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f97a2e-7c0d-4442-ae37-3ba7fae01d49]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:04 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd Aug 05 16:06:04 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:04 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 1073741824" returned: 0 in 0.472s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:04 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 Aug 05 16:06:04 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:04 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" returned: 0 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:04 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd Aug 05 16:06:04 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:04 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.846s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1725984600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e045cc6b-dae5-4193-b56d-957b1d564829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:00Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume e045cc6b-dae5-4193-b56d-957b1d564829 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:04 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8392502b-8850-4296-8683-807fe1916361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891899fe-72c9-45c0-807f-e2cbb9648349', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:05 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 1073741824 Aug 05 16:06:05 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc627ba-63d1-4a67-a5d6-8b5b3b0874c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-891899fe-72c9-45c0-807f-e2cbb9648349 (891899fe-72c9-45c0-807f-e2cbb9648349): created successfully Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc627ba-63d1-4a67-a5d6-8b5b3b0874c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (4fd7b9f3-8201-4cfe-ae47-90a981efc18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f8d925ed-ff29-492e-bea4-d7b7b216896e tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:06:05 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-397d61f2-9a62-4078-b7b6-b4ebbd020bdd" released by "delete_volume" :: held 0.750s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Created reservations ['e31a9ac0-15fa-4b2e-b77c-dcbaa07d2e4d', '672d4a63-f9f6-4cde-b2b9-b04cfb91901b', '714adfe2-11e4-4776-87b0-2bd7763b2854', 'a798ffa1-f6d0-4b17-9a0c-6d4bb5733eef'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:05 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-99655fc1-2cc6-430d-ba9a-95f232f683b8-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-99655fc1-2cc6-430d-ba9a-95f232f683b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:05 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-quobyte-99655fc1-2cc6-430d-ba9a-95f232f683b8" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 1073741824" returned: 0 in 0.527s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:05 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-99655fc1-2cc6-430d-ba9a-95f232f683b8" acquired by "delete_volume" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.327s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Deleted volume successfully. Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc6ad8-5757-4a67-b699-50b437261741]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad453f41-daa0-44d4-b6a1-69eeb39a8f93 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-397d61f2-9a62-4078-b7b6-b4ebbd020bdd-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:05 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 Aug 05 16:06:05 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:05 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 Aug 05 16:06:05 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:05 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.284s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153045263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4743826-b0ca-48fc-b6c3-54eb3221d84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:00Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume e4743826-b0ca-48fc-b6c3-54eb3221d84e {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e 1073741824 Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2d4a0d-4a24-4c39-b943-19afaa176aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e045cc6b-dae5-4193-b56d-957b1d564829', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:05 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5a19a-d861-4286-980a-4baaf9e12835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-e045cc6b-dae5-4193-b56d-957b1d564829 (e045cc6b-dae5-4193-b56d-957b1d564829): created successfully Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e5a19a-d861-4286-980a-4baaf9e12835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (63487d05-f9a6-4e86-bb37-8b84b08f8a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3cd9c25f-3a05-40ec-9083-3443b8fbd062 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:06:05 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8" returned: 0 in 0.389s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:05 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8 Aug 05 16:06:05 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:06 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-99655fc1-2cc6-430d-ba9a-95f232f683b8" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-99655fc1-2cc6-430d-ba9a-95f232f683b8" released by "delete_volume" :: held 0.720s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Created reservations ['1c5cce47-42d9-4aec-b0e9-7a2249c418e1', 'ad59ec09-0dd1-4f7b-b2af-bc4090acb1f1', 'b27c0976-1aa5-4a23-af6a-2c9fb4719f36', 'dc313c97-7e83-42e8-9dc9-4b4c5a252b1a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:06 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e 1073741824" returned: 0 in 0.523s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:06 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:06 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:06 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e Aug 05 16:06:06 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-quobyte-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:06 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.275s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Deleted volume successfully. Aug 05 16:06:06 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8e2dc9-3c49-42eb-9e94-74d895be0e12]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.702s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825627099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f19790-baf1-430a-8e41-6d99f3712ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191dbea56f1e45daa3b9946a3cd14c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:01Z,use_quota=True,user_id='c6965a4c282b4a9687b15d6f6a572ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Creating volume c4f19790-baf1-430a-8e41-6d99f3712ee2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:06 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:06 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 1073741824 Aug 05 16:06:06 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7c7bdcc5-78bb-431c-bbd6-b584894836b8 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-99655fc1-2cc6-430d-ba9a-95f232f683b8-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f0ccd9-4f45-4ffb-a6b0-2c1b36ce6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a108cb1c-9b23-4574-9aa0-9fd67da5707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:06 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e (e4743826-b0ca-48fc-b6c3-54eb3221d84e): created successfully Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a108cb1c-9b23-4574-9aa0-9fd67da5707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (c56778f5-7c77-418d-abc5-10f38e88a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c35f2e9d-884a-47b3-8712-eb49939f830a tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:06:06 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 Aug 05 16:06:06 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:07 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" returned: 0 in 0.401s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:07 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 1073741824" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938 Aug 05 16:06:07 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:07 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 Aug 05 16:06:07 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:07 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938" released by "delete_volume" :: held 0.725s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:07 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2" returned: 0 in 0.264s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.809s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2041a1e9-01d8-4118-8744-4645aa7f560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f19790-baf1-430a-8e41-6d99f3712ee2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8582db-1c95-4b3f-98d5-70b110556305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Created reservations ['6cfa86a2-3676-4322-b9ef-a007ac349658', '9e1ad946-05c2-4176-a523-580127411337', '1bf00ae9-2a18-486a-84bb-1a69376ab9fd', 'c3356382-ef35-4880-a0b6-f1c796a3ee57'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating offline snapshot f1e0beb9-1641-4418-9d38-ecb2afb50e01 of volume 1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:06:07 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Volume volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 (c4f19790-baf1-430a-8e41-6d99f3712ee2): created successfully Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8582db-1c95-4b3f-98d5-70b110556305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Flow 'volume_create_manager' (a358f31b-7f49-4d88-958c-b3a033922b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1e065-2092-4e4b-b8f2-247207d4d019]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-50916c53-1035-4508-9739-124e1e61e7f0 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created volume successfully. Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:07 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:07 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:07 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 Aug 05 16:06:07 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-0caffa32-af75-4f28-820f-a269de5c8aae-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-0caffa32-af75-4f28-820f-a269de5c8aae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-quobyte-0caffa32-af75-4f28-820f-a269de5c8aae" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-0caffa32-af75-4f28-820f-a269de5c8aae" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b80a5e-e019-436f-a8f9-1aa0a40757e4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:07 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.310s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:07 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Deleted volume successfully. Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-60836c61-091c-4ecc-a049-146bb6525df4 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-aee9d5ef-beaf-432d-bdf9-ba0fd2bdf938-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:07 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41" returned: 0 in 0.435s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 1G Aug 05 16:06:08 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae Aug 05 16:06:08 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae" returned: 0 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae Aug 05 16:06:08 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 1G" returned: 0 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 Aug 05 16:06:08 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0caffa32-af75-4f28-820f-a269de5c8aae" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-0caffa32-af75-4f28-820f-a269de5c8aae" released by "delete_volume" :: held 0.693s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Created reservations ['6bb6d3d1-2cc3-4558-ba55-767af9994df4', '36fe483a-39ac-411b-9a39-2096117866a6', 'ca920bc6-b907-4c20-9509-394e0304d6fa', '17025616-6187-4fc1-bfd2-414f8fc1d7a5'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-c4f19790-baf1-430a-8e41-6d99f3712ee2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-c4f19790-baf1-430a-8e41-6d99f3712ee2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:08 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01" returned: 0 in 0.383s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:08 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 is being set with open permissions: ugo+rw Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:08 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-c4f19790-baf1-430a-8e41-6d99f3712ee2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-c4f19790-baf1-430a-8e41-6d99f3712ee2" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:08 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 Aug 05 16:06:08 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[724110f9-1f35-4948-8b6d-5ea3bd7ce06c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:08 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 Aug 05 16:06:09 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-6bbf2c12-b84d-447a-9e84-9e095fe80c77-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:09 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-6bbf2c12-b84d-447a-9e84-9e095fe80c77-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Deleted volume successfully. Aug 05 16:06:09 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c3eb9181-832c-4390-bc24-4434fade5cfc tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-0caffa32-af75-4f28-820f-a269de5c8aae-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01" returned: 0 in 0.336s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "cinder-quobyte-6bbf2c12-b84d-447a-9e84-9e095fe80c77" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-6bbf2c12-b84d-447a-9e84-9e095fe80c77" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b416c3e7-b028-4648-bea7-fa82b9c1ba90]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info Aug 05 16:06:09 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2" returned: 0 in 0.413s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2 Aug 05 16:06:09 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 Aug 05 16:06:09 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info is being set with open permissions: ugo+rw Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info Aug 05 16:06:09 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c4f19790-baf1-430a-8e41-6d99f3712ee2" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-c4f19790-baf1-430a-8e41-6d99f3712ee2" released by "delete_volume" :: held 0.766s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:09 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77" returned: 0 in 0.417s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77 Aug 05 16:06:09 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['570423d4-60b8-4558-b7b2-05a83a65f52f', 'ef7ae7cb-c8c8-435f-8a32-289ed75139dc', 'f70c4d85-d900-4f85-ac24-396e9d54eb03', 'c5bd750c-8ad4-4458-b30f-fc5bf7632c78'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.info" returned: 0 in 0.303s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:09 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.629s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1c8877-2c71-422f-97b9-57f6de6d2b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73f50fc2d8f430e9ee4b08ca7697b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:01Z,use_quota=True,user_id='4a6bf95301ac4bd1920924997e5730fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(673fdae3-38aa-406a-bf4f-8fd08999cd7e),volume_type_id=673fdae3-38aa-406a-bf4f-8fd08999cd7e)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Creating volume cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:09 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:09 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6417f80f-870d-46e6-b5fd-431377f4cadd tempest-CreateVolumesFromSnapshotTest-1554970331 None] Create snapshot completed successfully Aug 05 16:06:09 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1073741824 Aug 05 16:06:09 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-e4743826-b0ca-48fc-b6c3-54eb3221d84e-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-e4743826-b0ca-48fc-b6c3-54eb3221d84e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-6bbf2c12-b84d-447a-9e84-9e095fe80c77" returned: 0 in 0.297s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:09 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-quobyte-6bbf2c12-b84d-447a-9e84-9e095fe80c77" released by "delete_volume" :: held 0.803s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-e4743826-b0ca-48fc-b6c3-54eb3221d84e" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-e4743826-b0ca-48fc-b6c3-54eb3221d84e" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[715866cd-5304-4baf-8cfb-382d23b16ac5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Created reservations ['60921b19-64f7-4c37-949f-ed3d3595f5a2', '63d975ee-0a1b-4004-8e40-fea5f7981665', '86bcf340-38e5-4010-ad07-92119e296b61', '911603e1-71ff-4064-bf0a-34e8c692f891'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:10 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.358s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-27bdf614-b531-4722-8272-c3cadb3d0713 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-c4f19790-baf1-430a-8e41-6d99f3712ee2-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:10 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e Aug 05 16:06:10 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:10 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:10 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:10 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1073741824" returned: 0 in 0.739s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:10 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Deleted volume successfully. Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5e36188d-bf01-46c5-bdb2-bec9a63d1986 tempest-CreateVolumesFromImageTest-749374805 None] Lock "cinder-6bbf2c12-b84d-447a-9e84-9e095fe80c77-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:10 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:10 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:10 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e" returned: 0 in 0.710s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:10 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:10 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (8edb097d-2376-4c12-991d-44bde0bacd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc35b197-126f-46a6-859b-7a2060ff9dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc35b197-126f-46a6-859b-7a2060ff9dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1827538679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032ccb6b-ba8b-4ac9-b819-3d63aec02f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:11Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90f7a88-1460-4ba4-a831-c9c680b62294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90f7a88-1460-4ba4-a831-c9c680b62294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9258283-8e74-4764-8c90-070366fe4755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9258283-8e74-4764-8c90-070366fe4755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032ccb6b-ba8b-4ac9-b819-3d63aec02f55', 'volume_name': 'volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f31ee7f-f220-4f22-aeef-e41bffcab7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f31ee7f-f220-4f22-aeef-e41bffcab7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fc50c3-c32b-42c3-abe6-a803ec0e6a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:10 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume 032ccb6b-ba8b-4ac9-b819-3d63aec02f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55', 'volume_size': 1} Aug 05 16:06:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:11 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 0 in 0.467s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1827538679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032ccb6b-ba8b-4ac9-b819-3d63aec02f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:11Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume 032ccb6b-ba8b-4ac9-b819-3d63aec02f55 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:11 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:11 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:11 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 1073741824 Aug 05 16:06:11 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e4743826-b0ca-48fc-b6c3-54eb3221d84e" returned: 0 in 0.384s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Attempting download of b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b ((None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}])) to volume cb1c8877-2c71-422f-97b9-57f6de6d2b70. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-e4743826-b0ca-48fc-b6c3-54eb3221d84e" released by "delete_volume" :: held 1.166s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (badaab00-51dc-40a9-b606-95ebcf397b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f75f12-79d4-4843-8869-2d03eb71e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f75f12-79d4-4843-8869-2d03eb71e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940146599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a2331-ab7b-4d57-a3a9-6d0858157d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:11Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f28ec-9c3d-42b5-9dce-0ed058d89615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2f28ec-9c3d-42b5-9dce-0ed058d89615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7b6620-f907-428a-b032-6433107f5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7b6620-f907-428a-b032-6433107f5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8a2331-ab7b-4d57-a3a9-6d0858157d61', 'volume_name': 'volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb526b99-8106-404f-bea5-7c6e6655e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb526b99-8106-404f-bea5-7c6e6655e198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d886994a-359b-4df0-99cd-2731c45d534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume ea8a2331-ab7b-4d57-a3a9-6d0858157d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61', 'volume_size': 1} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b14e2b-5954-496f-aa15-fd261835523c]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['bfdaa525-393c-4622-b04a-43689ada5529', '04007339-6310-4188-bec3-186e4f2c03a8', 'f2202f6b-ec38-43dd-a204-176dfd50d5fb', '4bdd19eb-0d67-49d3-8732-15c6bd96698f'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:11 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk Aug 05 16:06:11 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:11 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:11 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:11 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 1073741824" returned: 0 in 0.761s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (8da68477-c984-4a0c-955f-171dab28ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:11 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8927a6-46e0-4b34-91f1-82394405eac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:11 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:12 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk" returned: 0 in 0.669s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.462s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8927a6-46e0-4b34-91f1-82394405eac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669965089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078a9c8e-5734-432c-bdc4-5d1ecd45ad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:12Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 Aug 05 16:06:12 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85182c-9ca0-49d5-9816-d9087de09e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85182c-9ca0-49d5-9816-d9087de09e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558d4ae4-710c-496c-9297-99a56c26a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558d4ae4-710c-496c-9297-99a56c26a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '078a9c8e-5734-432c-bdc4-5d1ecd45ad9a', 'volume_name': 'volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d204ab6f-a4d4-4ac7-b99c-ccfa1bc51999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d204ab6f-a4d4-4ac7-b99c-ccfa1bc51999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854eade4-75bc-4896-8f5c-ffb85e82b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume 078a9c8e-5734-432c-bdc4-5d1ecd45ad9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a', 'volume_size': 1} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ffb162b4-da54-4b7d-937a-9b99dd481420 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-e4743826-b0ca-48fc-b6c3-54eb3221d84e-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-e045cc6b-dae5-4193-b56d-957b1d564829-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-e045cc6b-dae5-4193-b56d-957b1d564829-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:12 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk Aug 05 16:06:12 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-e045cc6b-dae5-4193-b56d-957b1d564829" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-e045cc6b-dae5-4193-b56d-957b1d564829" acquired by "delete_volume" :: waited 0.047s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db191e-5307-4e1b-b5fd-668d0c71cd03]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:12 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (1f1f0abf-c4b7-481d-b035-7da7bb60905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33121a63-86f8-4c07-bc0c-1a6db4c031d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" returned: 0 in 0.629s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940146599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a2331-ab7b-4d57-a3a9-6d0858157d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:11Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume ea8a2331-ab7b-4d57-a3a9-6d0858157d61 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:12 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:12 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 Aug 05 16:06:12 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33121a63-86f8-4c07-bc0c-1a6db4c031d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934599843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06cfca9-a30c-4960-8661-391d98b595f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:13Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d238348b-6040-4880-b0ce-d6539f029c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d238348b-6040-4880-b0ce-d6539f029c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f03d3a-b5c2-41c4-a158-e95334c0b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f03d3a-b5c2-41c4-a158-e95334c0b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06cfca9-a30c-4960-8661-391d98b595f6', 'volume_name': 'volume-c06cfca9-a30c-4960-8661-391d98b595f6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 1073741824 Aug 05 16:06:12 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceca5259-f1ad-445d-a4d1-9ed2b228ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceca5259-f1ad-445d-a4d1-9ed2b228ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660b54eb-965c-4f7f-9f8e-cfe072bc235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume c06cfca9-a30c-4960-8661-391d98b595f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06cfca9-a30c-4960-8661-391d98b595f6', 'volume_size': 1} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk" returned: 1 in 0.778s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_ob0nvixk' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fc50c3-c32b-42c3-abe6-a803ec0e6a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b831ccbf-a9d7-40be-a41d-fc06784e14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b33b3-99c8-4693-9c64-6bd0df49de6d]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 (032ccb6b-ba8b-4ac9-b819-3d63aec02f55): created successfully Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b831ccbf-a9d7-40be-a41d-fc06784e14aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (8edb097d-2376-4c12-991d-44bde0bacd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-603a1aee-056d-4a94-ac17-27bee339669a tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:13 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:13 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829" returned: 0 in 0.641s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829 Aug 05 16:06:13 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (851b9ee2-2d4b-46b4-87da-a086dd0edc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5733230d-d9b0-476e-bf36-402c3ea3b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5733230d-d9b0-476e-bf36-402c3ea3b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23024823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a3568a-4441-40e0-9e07-52f3d3e9da30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:13Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d24fd-a9e9-4ed1-9fab-e4da862fdd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d24fd-a9e9-4ed1-9fab-e4da862fdd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae86c26-70df-4d0a-a081-7de626d98b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae86c26-70df-4d0a-a081-7de626d98b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a3568a-4441-40e0-9e07-52f3d3e9da30', 'volume_name': 'volume-00a3568a-4441-40e0-9e07-52f3d3e9da30', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec0dd0d-f492-4532-9c7a-0d1808a8f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec0dd0d-f492-4532-9c7a-0d1808a8f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f83285-d5c9-4be2-a172-190e451c9c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume 00a3568a-4441-40e0-9e07-52f3d3e9da30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a3568a-4441-40e0-9e07-52f3d3e9da30', 'volume_size': 1} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:13 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 0 in 0.611s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e045cc6b-dae5-4193-b56d-957b1d564829" returned: 0 in 0.318s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 1073741824" returned: 0 in 0.788s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-e045cc6b-dae5-4193-b56d-957b1d564829" released by "delete_volume" :: held 1.033s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 Aug 05 16:06:13 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD Aug 05 16:06:13 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['d5bb1b20-a1bc-4754-96de-952315076cc6', '32ca8603-a8f5-46bb-b456-704ea4465955', 'd731774e-5c8c-41ab-9ad0-00ac3191e44f', 'f34d8592-d34c-4612-9d2b-6dc46755dd85'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:13 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b was raw, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669965089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078a9c8e-5734-432c-bdc4-5d1ecd45ad9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:12Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume 078a9c8e-5734-432c-bdc4-5d1ecd45ad9a {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:13 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:13 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:13 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d886994a-359b-4df0-99cd-2731c45d534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a 1073741824 Aug 05 16:06:13 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f29ad-eee8-44cf-b324-d60f3b2b5b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 (ea8a2331-ab7b-4d57-a3a9-6d0858157d61): created successfully Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f29ad-eee8-44cf-b324-d60f3b2b5b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (badaab00-51dc-40a9-b606-95ebcf397b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a7348091-e42d-4e86-94c6-7d813d968de9 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:14 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f256f3ce-6544-4b31-b42d-545e466626ce tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-e045cc6b-dae5-4193-b56d-957b1d564829-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:14 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 0 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b_rxomlq6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:06:14 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:14 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1G Aug 05 16:06:14 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:14 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a 1073741824" returned: 0 in 0.557s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:14 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a Aug 05 16:06:14 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:14 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 1G" returned: 0 in 0.373s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-891899fe-72c9-45c0-807f-e2cbb9648349-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-891899fe-72c9-45c0-807f-e2cbb9648349-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d12b08-1330-4411-a1eb-b7de256cce87]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-891899fe-72c9-45c0-807f-e2cbb9648349" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-891899fe-72c9-45c0-807f-e2cbb9648349" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:14 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78fa24c-56a3-4b92-af92-14037ad8be05]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:14 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:14 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.094s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934599843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06cfca9-a30c-4960-8661-391d98b595f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:13Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume c06cfca9-a30c-4960-8661-391d98b595f6 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:14 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:14 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 1073741824 Aug 05 16:06:14 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854eade4-75bc-4896-8f5c-ffb85e82b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce59e8e-7a5b-4232-a94b-f9c544806765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Flow 'volume_create_manager' (26617def-3309-414b-ab8d-6f7cb03fea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30175d2b-ac64-42fc-af28-9fc9a853392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a (078a9c8e-5734-432c-bdc4-5d1ecd45ad9a): created successfully Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce59e8e-7a5b-4232-a94b-f9c544806765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (8da68477-c984-4a0c-955f-171dab28ad05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:14 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 Aug 05 16:06:14 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30175d2b-ac64-42fc-af28-9fc9a853392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1519407683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25357376-03c2-42b5-9f6e-23580cede625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a2aa48fea2489c90a7ccd9fc461e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:15Z,use_quota=True,user_id='6bfd9522d6914ba2896e771c7936ff57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ac1d84-fc43-4c27-99db-cdd75d9eb2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ac1d84-fc43-4c27-99db-cdd75d9eb2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa250ae-506c-41a6-932f-6a5908e01409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa250ae-506c-41a6-932f-6a5908e01409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25357376-03c2-42b5-9f6e-23580cede625', 'volume_name': 'volume-25357376-03c2-42b5-9f6e-23580cede625', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acc79c1-ad21-431d-a71d-d232b1982b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acc79c1-ad21-431d-a71d-d232b1982b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c06073-fe9e-4a69-ac12-43cd3b8b2c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Volume 25357376-03c2-42b5-9f6e-23580cede625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25357376-03c2-42b5-9f6e-23580cede625', 'volume_size': 1} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2e7fe942-1923-4566-94be-b6dd74036240 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:15 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 0 in 0.414s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:15 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:15 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349" returned: 0 in 0.444s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:15 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349 Aug 05 16:06:15 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 1073741824" returned: 0 in 0.547s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:15 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 Aug 05 16:06:15 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 1 in 0.398s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Downloaded image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b ((None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}])) to volume cb1c8877-2c71-422f-97b9-57f6de6d2b70 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Temporary image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b for user 4a6bf95301ac4bd1920924997e5730fd is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Marking volume cb1c8877-2c71-422f-97b9-57f6de6d2b70 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Copying metadata from image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b to cb1c8877-2c71-422f-97b9-57f6de6d2b70. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Creating volume glance metadata for volume cb1c8877-2c71-422f-97b9-57f6de6d2b70 backed by image b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '93f41de703f7438e62799bc400810418', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 16:06:15 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-891899fe-72c9-45c0-807f-e2cbb9648349" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-891899fe-72c9-45c0-807f-e2cbb9648349" released by "delete_volume" :: held 0.806s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311b57eb-432f-4c75-9bcf-1498f2ce1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70', 'volume_size': 1, 'image_id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f41de703f7438e62799bc400810418', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f73f50fc2d8f430e9ee4b08ca7697b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e341574266441625fe6df840ae84bd607d9d470806695623a96fce91f0c39a04fe17d2d19a7073a908ba292d79a2ef75556b714d28e6c5077576bf364a831628', 'id': 'b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b', 'created_at': datetime.datetime(2026, 8, 5, 14, 5, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4d9f3a6-5c1d-4182-a573-278b0a4b3f0b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfab986-67e7-465f-9d6f-3fbc170385ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Volume volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 (cb1c8877-2c71-422f-97b9-57f6de6d2b70): created successfully Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfab986-67e7-465f-9d6f-3fbc170385ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Flow 'volume_create_manager' (17a7825a-08ce-481e-9aeb-22fa5fb48b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f7440f7b-0149-416c-9388-219310042882 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Created volume successfully. Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['3a8bd4c1-9f4c-46f2-99f2-1f447c72f0ef', '93ba9570-3e1c-446d-8371-d48456827669', '0c9817a1-4eac-4e27-af7f-4c63cec5fbea', 'd379ea73-1323-448d-92b6-c04836288dcb'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:15 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-23024823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a3568a-4441-40e0-9e07-52f3d3e9da30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de69f6ae9264465a8bf6e0100f508a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:13Z,use_quota=True,user_id='a4189c1d01fa4df4836c16493545932b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Creating volume 00a3568a-4441-40e0-9e07-52f3d3e9da30 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:15 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 1073741824 Aug 05 16:06:15 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (660b54eb-965c-4f7f-9f8e-cfe072bc235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06cfca9-a30c-4960-8661-391d98b595f6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c481d26a-07c3-43dc-97a7-604fd078935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-c06cfca9-a30c-4960-8661-391d98b595f6 (c06cfca9-a30c-4960-8661-391d98b595f6): created successfully Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c481d26a-07c3-43dc-97a7-604fd078935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (1f1f0abf-c4b7-481d-b035-7da7bb60905d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:15 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:15 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-597011b4-2003-4317-a55c-b9051376d9af-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-02f7d915-8bb0-48da-958c-d4a7dabeaf1c tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-597011b4-2003-4317-a55c-b9051376d9af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-597011b4-2003-4317-a55c-b9051376d9af" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-597011b4-2003-4317-a55c-b9051376d9af" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa3370b-0024-447e-9fef-ec14b36370aa]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af Aug 05 16:06:16 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:16 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.371s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ab57d17-4dd3-41d2-8be1-b3a9cddb9117 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-891899fe-72c9-45c0-807f-e2cbb9648349-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Acquiring lock "cinder-cb1c8877-2c71-422f-97b9-57f6de6d2b70-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "cinder-cb1c8877-2c71-422f-97b9-57f6de6d2b70-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Acquiring lock "cinder-quobyte-cb1c8877-2c71-422f-97b9-57f6de6d2b70" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "cinder-quobyte-cb1c8877-2c71-422f-97b9-57f6de6d2b70" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:16 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 1073741824" returned: 0 in 0.613s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8d2a96-3209-4837-b1d4-6c47580b2a15]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 Aug 05 16:06:16 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:16 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af" returned: 0 in 0.500s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:16 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af Aug 05 16:06:16 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:16 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:16 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1519407683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25357376-03c2-42b5-9f6e-23580cede625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a2aa48fea2489c90a7ccd9fc461e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:15Z,use_quota=True,user_id='6bfd9522d6914ba2896e771c7936ff57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Creating volume 25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:16 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f83285-d5c9-4be2-a172-190e451c9c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a3568a-4441-40e0-9e07-52f3d3e9da30', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4ab1cf-b541-4a53-8145-e95ae693deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:16 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 1073741824 Aug 05 16:06:16 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:16 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Volume volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 (00a3568a-4441-40e0-9e07-52f3d3e9da30): created successfully Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4ab1cf-b541-4a53-8145-e95ae693deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:16 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Flow 'volume_create_manager' (851b9ee2-2d4b-46b4-87da-a086dd0edc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-597011b4-2003-4317-a55c-b9051376d9af" returned: 0 in 0.302s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4f979217-03a6-4576-b6d4-b650b8fe08b8 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created volume successfully. Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-597011b4-2003-4317-a55c-b9051376d9af" released by "delete_volume" :: held 0.853s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:16 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['43720dfb-016b-4fec-bb12-e1de0e586d07', '6f7bfc3a-9993-4350-86e6-02d6ccc4bc20', '848615e0-e578-4bca-8efa-020ed2f7d4b8', '7c9387a9-f631-4ba6-ba22-8e5324e92329'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:16 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:16 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:17 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "cinder-quobyte-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d16a4-a321-4410-90e5-6169175edb32]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 1 in 0.431s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 1073741824" returned: 0 in 0.580s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70 Aug 05 16:06:17 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.337s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd Aug 05 16:06:17 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a80de6f2-722c-4d42-87e1-e0a542b8455f tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-597011b4-2003-4317-a55c-b9051376d9af-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:17 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:17 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-cb1c8877-2c71-422f-97b9-57f6de6d2b70" returned: 0 in 0.281s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "cinder-quobyte-cb1c8877-2c71-422f-97b9-57f6de6d2b70" released by "delete_volume" :: held 1.224s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Created reservations ['6e02c875-b239-4a2e-8a77-a22f9ed9f3f8', '0416af51-c4ac-4f27-bdbb-11f53f710c07', '65bd1c06-5918-444f-8902-377a652e8d2b', '0f2442e4-2cdc-41c4-b69d-b3e78ff317ce'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:17 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.304s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:17 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c06073-fe9e-4a69-ac12-43cd3b8b2c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25357376-03c2-42b5-9f6e-23580cede625', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2e0862-9cfb-4f28-a898-4ad3d507d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" returned: 0 in 0.455s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Volume volume-25357376-03c2-42b5-9f6e-23580cede625 (25357376-03c2-42b5-9f6e-23580cede625): created successfully Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2e0862-9cfb-4f28-a898-4ad3d507d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:17 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd Aug 05 16:06:17 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Flow 'volume_create_manager' (26617def-3309-414b-ab8d-6f7cb03fea4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-00a3568a-4441-40e0-9e07-52f3d3e9da30-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-00a3568a-4441-40e0-9e07-52f3d3e9da30-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-70e4547f-b34e-4ab3-8b3b-9596205f92cb tempest-VolumeDependencyTests-778096117 None] Created volume successfully. Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:17 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-00a3568a-4441-40e0-9e07-52f3d3e9da30" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-00a3568a-4441-40e0-9e07-52f3d3e9da30" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d41d6-ce64-436b-877c-bbd9d1e8adf2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:17 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" returned: 0 in 0.294s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 Aug 05 16:06:18 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-quobyte-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd" released by "delete_volume" :: held 0.805s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Created reservations ['c3ecf380-dcc3-4b51-90b9-60c87ca3d95d', 'fbcf5e80-91a1-4152-ae50-8a8c40c3fe05', 'f6ad19e3-8e45-4933-bb68-9a13108a7a75', '89331402-f887-4a33-a9aa-1a87c77eb731'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:18 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.338s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Deleted volume successfully. Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fcf6f865-e33e-4837-8286-0902f9ce7c57 tempest-VolumeAndVolumeTypeFromImageTest-1572221171 None] Lock "cinder-cb1c8877-2c71-422f-97b9-57f6de6d2b70-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Creating offline snapshot 43db97a3-aab4-4c55-8155-db0bf23324d2 of volume 25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2da48-cc38-4f09-8034-30c46d8b1f94]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:18 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:18 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:18 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30" returned: 0 in 0.483s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:18 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30 Aug 05 16:06:18 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:18 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:18 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:18 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Deleted volume successfully. Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a75bd366-c2a6-4515-8ad8-6e72cc140054 tempest-CreateVolumesFromSourceVolumeTest-1330674510 None] Lock "cinder-774d6b44-d5cf-475c-9d4c-5c34b1cc3acd-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:18 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-00a3568a-4441-40e0-9e07-52f3d3e9da30" returned: 0 in 0.340s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-00a3568a-4441-40e0-9e07-52f3d3e9da30" released by "delete_volume" :: held 0.877s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['43aae2a0-1b38-4c8d-8652-d0eb0832a9c5', 'fed202c6-a6a4-4c26-945d-42e88525937d', '257762d0-bd14-4c61-afe1-b52b2f92c3a0', '7e1e4beb-195d-4eff-a1a7-9512426bf465'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:18 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.554s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:18 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 1G Aug 05 16:06:18 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:18 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:18 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:19 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-261a7598-277f-4086-93a1-f16318be8e57 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-00a3568a-4441-40e0-9e07-52f3d3e9da30-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:19 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 1G" returned: 0 in 0.550s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25357376-03c2-42b5-9f6e-23580cede625 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:19 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25357376-03c2-42b5-9f6e-23580cede625 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:19 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:19 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25357376-03c2-42b5-9f6e-23580cede625 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.326s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:19 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 is being set with open permissions: ugo+rw Aug 05 16:06:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:19 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:19 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-c06cfca9-a30c-4960-8661-391d98b595f6-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-c06cfca9-a30c-4960-8661-391d98b595f6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-c06cfca9-a30c-4960-8661-391d98b595f6" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:20 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-c06cfca9-a30c-4960-8661-391d98b595f6" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.436s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddfd2b9-f3c4-4316-81ef-955bd3cc8ac5]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:20 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info Aug 05 16:06:20 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:20 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 Aug 05 16:06:20 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:20 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info" returned: 0 in 0.333s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:20 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info is being set with open permissions: ugo+rw Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:20 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info Aug 05 16:06:20 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:20 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6" returned: 0 in 0.456s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:20 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6 Aug 05 16:06:20 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:20 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.info" returned: 0 in 0.314s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d5b806c9-0710-4caf-a208-198e90f4fb42 tempest-VolumeDependencyTests-778096117 None] Create snapshot completed successfully Aug 05 16:06:21 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c06cfca9-a30c-4960-8661-391d98b595f6" returned: 0 in 0.397s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-c06cfca9-a30c-4960-8661-391d98b595f6" released by "delete_volume" :: held 0.918s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['3bd19b4f-c152-475c-bd1a-8bbacfcd1268', 'aa2e8eba-784f-42c6-8bf3-d2f91efd8780', '9e3e11c6-70a1-455e-b042-754109a2815b', 'cfbe01b3-6e86-487d-9d33-37ca5992f886'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:21 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:21 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:21 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.311s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c1ff591c-1cf6-4788-8c24-93641799051f tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-c06cfca9-a30c-4960-8661-391d98b595f6-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Flow 'volume_create_manager' (fd1e94bc-2b56-4fa8-a20e-8832b17b264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d15c69f-1388-4e9b-a45a-d0507fe38aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d15c69f-1388-4e9b-a45a-d0507fe38aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-898529313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59eeb885-3e3f-42ed-bd7e-52f536fe047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a2aa48fea2489c90a7ccd9fc461e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43db97a3-aab4-4c55-8155-db0bf23324d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:22Z,use_quota=True,user_id='6bfd9522d6914ba2896e771c7936ff57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b341147-31fb-485b-8c55-a120ca96af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b341147-31fb-485b-8c55-a120ca96af3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27e600b-7ea0-4831-908b-e6b97492b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27e600b-7ea0-4831-908b-e6b97492b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59eeb885-3e3f-42ed-bd7e-52f536fe047f', 'volume_name': 'volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f', 'volume_size': 1, 'snapshot_id': '43db97a3-aab4-4c55-8155-db0bf23324d2'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3282e4-a899-4419-989a-68ac024f86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3282e4-a899-4419-989a-68ac024f86f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5c5e5b-b5ac-4bdb-85bd-d20fc659af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:22 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Volume 59eeb885-3e3f-42ed-bd7e-52f536fe047f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f', 'volume_size': 1, 'snapshot_id': '43db97a3-aab4-4c55-8155-db0bf23324d2'} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2-59eeb885-3e3f-42ed-bd7e-52f536fe047f" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2-59eeb885-3e3f-42ed-bd7e-52f536fe047f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Creating volume 59eeb885-3e3f-42ed-bd7e-52f536fe047f from snapshot 43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] snapshot: 43db97a3-aab4-4c55-8155-db0bf23324d2, volume: 59eeb885-3e3f-42ed-bd7e-52f536fe047f, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[70225aa5-4feb-40f8-bd1e-a7f645bea23f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:22 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:22 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f73b0-31c4-44e9-bc6e-f765992d2075]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:22 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a Aug 05 16:06:22 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:22 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.492s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25357376-03c2-42b5-9f6e-23580cede625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bdc700-bbca-49f8-b3a8-43cb96f93078]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:22 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:22 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:22 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" returned: 0 in 0.487s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:23 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a Aug 05 16:06:23 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:23 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:23 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f Aug 05 16:06:23 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:23 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" returned: 0 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a" released by "delete_volume" :: held 0.881s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['a2e7b192-bbca-43fb-a807-b40fee312e76', '9aef6081-7289-454e-8cba-65ef1edbeb47', 'f28e82a9-cef7-4f42-9e15-90a1944dd4d2', 'fe27af88-4de7-4f48-85ee-06013c73100c'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:23 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:23 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:23 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0fc43878-49d1-4fab-97a0-1cb8f59bbfbb tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-078a9c8e-5734-432c-bdc4-5d1ecd45ad9a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-ea8a2331-ab7b-4d57-a3a9-6d0858157d61-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-ea8a2331-ab7b-4d57-a3a9-6d0858157d61-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd7fc1-7b31-41b6-bff5-7adb38cffadf]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:24 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 Aug 05 16:06:24 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Flow 'volume_create_manager' (83e641d2-66a9-464d-9a60-0346e38c567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae934133-aba3-45cf-8578-ba06988bd6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae934133-aba3-45cf-8578-ba06988bd6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fb2afd-0f17-45bf-bdb9-4891b705cb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bf4d8ddf31469690613e588fe87ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:25Z,use_quota=True,user_id='8f7faffbc12045ccaff397e421ad45a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47328b06-490a-4bbf-8925-c4dd7fea87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47328b06-490a-4bbf-8925-c4dd7fea87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc7ae1f-6999-4983-8d2e-ebdf5c005d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc7ae1f-6999-4983-8d2e-ebdf5c005d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fb2afd-0f17-45bf-bdb9-4891b705cb81', 'volume_name': 'volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10df2d7-46fc-463d-93d4-d12f9a960f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10df2d7-46fc-463d-93d4-d12f9a960f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7d344-55a5-4e2f-a463-0312e7a74d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:25 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Volume 79fb2afd-0f17-45bf-bdb9-4891b705cb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81', 'volume_size': 1} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:25 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" returned: 0 in 0.914s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:25 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61 Aug 05 16:06:25 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:26 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" returned: 0 in 0.741s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-ea8a2331-ab7b-4d57-a3a9-6d0858157d61" released by "delete_volume" :: held 1.801s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['a5a4ad21-8994-48fc-8588-6ca1fe4b2805', '35ed36af-3548-44f9-b049-7095a826825c', 'bb498189-5423-4802-abae-42313cc6b8c2', '92ed7135-35ed-4dca-a65d-b2e91958cdf0'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:26 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:26 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-032ccb6b-ba8b-4ac9-b819-3d63aec02f55-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:27 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-032ccb6b-ba8b-4ac9-b819-3d63aec02f55-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.630s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-cbd4526d-dc5b-4ec2-a075-f2c069629c17 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-ea8a2331-ab7b-4d57-a3a9-6d0858157d61-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c9a796-642f-4c2a-9fc3-a17de2bc0777]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:27 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 Aug 05 16:06:27 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Flow 'volume_create_manager' (90e2ee0b-7d64-4e40-ba71-3c4c77f99041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52548e0d-971c-44f9-a4f9-357449d62c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52548e0d-971c-44f9-a4f9-357449d62c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce96d1-59f1-4b06-b263-543ddb67e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90427b7477094e6d8d0b007dcc37f8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:28Z,use_quota=True,user_id='8c184f768a954e02ac46433b5510bac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd0839-d8c5-454a-90dd-0d090d1da967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd0839-d8c5-454a-90dd-0d090d1da967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c369f2a9-5444-41bf-82fa-61ef38345abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:27 devstack cinder-volume[88715]: DEBUG cinder.image.glance [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Creating Keystone auth plugin from conf {{(pid=88715) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 16:06:28 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" returned: 0 in 1.035s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c369f2a9-5444-41bf-82fa-61ef38345abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6ce96d1-59f1-4b06-b263-543ddb67e2d4', 'volume_name': 'volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4', 'volume_size': 1, 'image_id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f25a02b2c09cfb745c71607d7b50f22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90427b7477094e6d8d0b007dcc37f8e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfa54cdb6838519bad5160c79a1c8f427158c4219141b3db7ffadcea0fdce1581c861b4d25d3ffb9021872e3aa4ab5c7621ddfb6282dae0d53422417a6f2763', 'id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'created_at': datetime.datetime(2026, 8, 5, 14, 6, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947dd51-3593-4efb-b1a9-98a8f0820035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:28 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55 Aug 05 16:06:28 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947dd51-3593-4efb-b1a9-98a8f0820035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29f4db-42b7-46dd-ae33-3dd2587880f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:28 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4', 'volume_size': 1, 'image_id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f25a02b2c09cfb745c71607d7b50f22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90427b7477094e6d8d0b007dcc37f8e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfa54cdb6838519bad5160c79a1c8f427158c4219141b3db7ffadcea0fdce1581c861b4d25d3ffb9021872e3aa4ab5c7621ddfb6282dae0d53422417a6f2763', 'id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'created_at': datetime.datetime(2026, 8, 5, 14, 6, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4/file', 'properties': {}}, 'image_service': } Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Trying to clone c6ce96d1-59f1-4b06-b263-543ddb67e2d4 from image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}]). {{(pid=88715) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 16:06:28 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Image download 0.00 MB at 0.00 MB/s Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4198af70-bdd6-47b8-a5a8-daa09037f4fc]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:28 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" returned: 0 in 0.595s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-032ccb6b-ba8b-4ac9-b819-3d63aec02f55" released by "delete_volume" :: held 1.770s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['323ab708-33c6-4f6a-ab55-151412e4bd8a', '8edbfc16-a014-4f06-90a1-7dae3a10b7f0', '1c9640fd-daca-4e7b-953e-d54057b563dd', 'adb5d487-f601-46fc-a5d5-337ecf395846'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:29 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:29 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f" returned: 0 in 5.982s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a97d3-337d-4eb0-8642-c0f46037ff36]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:29 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:29 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-f1e0beb9-1641-4418-9d38-ecb2afb50e01-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-f1e0beb9-1641-4418-9d38-ecb2afb50e01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-f1e0beb9-1641-4418-9d38-ecb2afb50e01" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-f1e0beb9-1641-4418-9d38-ecb2afb50e01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleting offline snapshot f1e0beb9-1641-4418-9d38-ecb2afb50e01 of volume 1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] snapshot_file for this snap is: volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eecd6e-a296-4f9c-b21a-f0c35fd563aa]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:29 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:29 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:29 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6d1d7d7b-c1df-49a0-9ec4-90ac2dcc3191 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-032ccb6b-ba8b-4ac9-b819-3d63aec02f55-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:29 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 Aug 05 16:06:29 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.609s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:06:29 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Converted 1024.00 MB image at 171.14 MB/s Aug 05 16:06:29 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f is being set with open permissions: ugo+rw Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Temporary image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 is fetched for user 8c184f768a954e02ac46433b5510bac0. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 16:06:29 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f Aug 05 16:06:29 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[133334b1-f5bb-415a-9e40-51e647bb8bf4]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:29 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01" returned: 0 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:29 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36c168b-edac-444f-beb6-52e72dcf9035]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:30 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f" returned: 0 in 0.292s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" released by "_copy_volume_from_snapshot" :: held 7.972s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:30 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2-59eeb885-3e3f-42ed-bd7e-52f536fe047f" released by "_create_volume_from_snapshot" :: held 8.003s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.022s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:30 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fb2afd-0f17-45bf-bdb9-4891b705cb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bf4d8ddf31469690613e588fe87ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:25Z,use_quota=True,user_id='8f7faffbc12045ccaff397e421ad45a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Creating volume 79fb2afd-0f17-45bf-bdb9-4891b705cb81 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:30 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 1073741824 Aug 05 16:06:30 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5c5e5b-b5ac-4bdb-85bd-d20fc659af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f', 'volume_size': 1, 'snapshot_id': '43db97a3-aab4-4c55-8155-db0bf23324d2'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1195810-9f00-4af0-b2b0-0037b6515094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:30 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Volume volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f (59eeb885-3e3f-42ed-bd7e-52f536fe047f): created successfully Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1195810-9f00-4af0-b2b0-0037b6515094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Flow 'volume_create_manager' (fd1e94bc-2b56-4fa8-a20e-8832b17b264f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:30 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6ab34995-aa30-4871-a95f-3f6b3993f940 tempest-VolumeDependencyTests-778096117 None] Created volume successfully. Aug 05 16:06:30 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41" returned: 0 in 0.411s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:30 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 Aug 05 16:06:30 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 1073741824" returned: 0 in 0.469s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 Aug 05 16:06:30 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01" returned: 0 in 0.368s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01 Aug 05 16:06:30 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce96d1-59f1-4b06-b263-543ddb67e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90427b7477094e6d8d0b007dcc37f8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:28Z,use_quota=True,user_id='8c184f768a954e02ac46433b5510bac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Creating volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:30 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7d344-55a5-4e2f-a463-0312e7a74d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:30 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1073741824 Aug 05 16:06:30 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:30 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cd6d32-3e94-43c1-951d-d16cb96a7d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:31 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Volume volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 (79fb2afd-0f17-45bf-bdb9-4891b705cb81): created successfully Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cd6d32-3e94-43c1-951d-d16cb96a7d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Flow 'volume_create_manager' (83e641d2-66a9-464d-9a60-0346e38c567b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5f43ff4d-89a7-44b5-bd5f-a529a66ce4b4 tempest-CinderUnicodeTest-697570496 None] Created volume successfully. Aug 05 16:06:31 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41.f1e0beb9-1641-4418-9d38-ecb2afb50e01" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-f1e0beb9-1641-4418-9d38-ecb2afb50e01" released by "_delete_snapshot" :: held 1.565s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" released by "delete_snapshot" :: held 1.592s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['79b8c4fa-c42f-463d-9ca8-dd34b20c13cb', '0650822b-c58f-4db6-9939-abf437d6242d', 'f0e8f66c-44d1-4ee6-bbea-fe68b9db395d', '2a5b55e8-18fd-4f40-b320-6fac45348390'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:31 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Delete snapshot completed successfully. Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-93b8993f-beb0-497c-93e3-6cbbcd907980 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-f1e0beb9-1641-4418-9d38-ecb2afb50e01-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-43db97a3-aab4-4c55-8155-db0bf23324d2-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-43db97a3-aab4-4c55-8155-db0bf23324d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Deleting offline snapshot 43db97a3-aab4-4c55-8155-db0bf23324d2 of volume 25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] snapshot_file for this snap is: volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[79728ddd-b443-4d30-a112-bd46ed146928]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:31 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1073741824" returned: 0 in 0.512s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:31 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:31 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:31 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:31 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-1294abdc-08fc-408d-b61a-c3ae4cad0c41-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-1294abdc-08fc-408d-b61a-c3ae4cad0c41-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" acquired by "delete_volume" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[77efca9e-e6d7-41d5-97e5-b2700be64c22]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:31 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Attempting download of 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}])) to volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 16:06:31 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.523s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25357376-03c2-42b5-9f6e-23580cede625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:06:31 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 Aug 05 16:06:31 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[38224024-932c-45de-aa69-ab1f0fc15e45]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:31 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4e1bb-8ad8-452a-a3bb-63f18f0ff58f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Flow 'volume_create_manager' (fc5a4840-cc17-4f4c-bab4-d7803248dd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:32 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug Aug 05 16:06:32 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31afa4f-5ce5-499c-8452-ce63876458bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31afa4f-5ce5-499c-8452-ce63876458bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-322725909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bf4d8ddf31469690613e588fe87ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:32Z,use_quota=True,user_id='8f7faffbc12045ccaff397e421ad45a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fea6976-f408-4c91-b301-89ad9ae98b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fea6976-f408-4c91-b301-89ad9ae98b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2161870c-2b72-497c-9df6-7584f9a91c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2161870c-2b72-497c-9df6-7584f9a91c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc', 'volume_name': 'volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f52ca-39d0-46b7-8095-29d11c3337f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14f52ca-39d0-46b7-8095-29d11c3337f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:32 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:32 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef79aa-f85e-486c-b431-a9ff539d0fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:32 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Volume ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc', 'volume_size': 1} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-322725909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bf4d8ddf31469690613e588fe87ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:32Z,use_quota=True,user_id='8f7faffbc12045ccaff397e421ad45a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Creating volume ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:32 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc 1073741824 Aug 05 16:06:32 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41" returned: 0 in 0.492s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41 Aug 05 16:06:32 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug" returned: 0 in 0.377s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.504s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:32 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1294abdc-08fc-408d-b61a-c3ae4cad0c41" returned: 0 in 0.313s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-quobyte-1294abdc-08fc-408d-b61a-c3ae4cad0c41" released by "delete_volume" :: held 0.910s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:32 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Created reservations ['baf9e343-7e65-4e7a-9e75-faee822d2291', '2d421918-0549-4f96-9ca9-5d866b78b5d3', '79ec3d52-1258-4ac5-98ea-3747ba019057', 'f36e0e39-5090-4d4a-a101-9242c357c6ec'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc 1073741824" returned: 0 in 0.497s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug" returned: 1 in 0.390s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_xwtcimug' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a64de-8b1e-4607-b7d7-9c29054d756f]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc Aug 05 16:06:32 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:32 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:32 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:32 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:32 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:33 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.505s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:33 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2 Aug 05 16:06:33 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:33 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ef79aa-f85e-486c-b431-a9ff539d0fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa26886-31dc-4b83-b1e0-c010f534fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Volume volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc (ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc): created successfully Aug 05 16:06:33 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa26886-31dc-4b83-b1e0-c010f534fca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Flow 'volume_create_manager' (fc5a4840-cc17-4f4c-bab4-d7803248dd57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9176f3dd-0b39-4e7a-a639-bc1133694a56 tempest-CinderUnicodeTest-697570496 None] Created volume successfully. Aug 05 16:06:33 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.454s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Deleted volume successfully. Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-449a0326-662a-4346-8c95-53116eec4ff2 tempest-CreateVolumesFromSnapshotTest-1554970331 None] Lock "cinder-1294abdc-08fc-408d-b61a-c3ae4cad0c41-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:33 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625.43db97a3-aab4-4c55-8155-db0bf23324d2" returned: 0 in 0.372s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-43db97a3-aab4-4c55-8155-db0bf23324d2" released by "_delete_snapshot" :: held 2.046s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" released by "delete_snapshot" :: held 2.078s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Created reservations ['636ce8da-624f-43e5-bada-6d11993ad3ce', 'f24b1b10-7cf7-4fa3-927d-7eeb8bd44df6', 'e5cf0233-71c9-4ddb-ba70-a926a26d8eb7', '5a1ceea6-d279-41c7-b102-dada7f5d900b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Delete snapshot completed successfully. Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0506f3af-f5a9-4413-88bc-67ee968bed32 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-43db97a3-aab4-4c55-8155-db0bf23324d2-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:33 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 was raw, converting to raw {{(pid=88715) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 16:06:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:33 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:33 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:33 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7dcc2e22-a3c3-4710-b989-6a1ace96c6d4_c2k_o42cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:06:34 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:34 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1G Aug 05 16:06:34 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:34 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 1G" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90ff06-909f-4368-98dd-701b2db823a9]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:34 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:34 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Creating offline snapshot 026096c4-739f-458f-9e67-006b459a891d of volume ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f17c34-ac24-4da5-8eae-d31aba932951]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-25357376-03c2-42b5-9f6e-23580cede625-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-25357376-03c2-42b5-9f6e-23580cede625-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:34 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc Aug 05 16:06:34 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ae49d-b510-4d47-8cdf-79006e17aca6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:34 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 0 in 0.463s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:34 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:34 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:34 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:34 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:35 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" returned: 0 in 0.502s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:35 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d 1G Aug 05 16:06:35 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:35 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 1 in 0.465s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Downloaded image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}])) to volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4 successfully. {{(pid=88715) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Temporary image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 for user 8c184f768a954e02ac46433b5510bac0 is deleted. {{(pid=88715) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.volume_utils [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Marking volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4 as bootable. {{(pid=88715) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 16:06:35 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.501s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Copying metadata from image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 to c6ce96d1-59f1-4b06-b263-543ddb67e2d4. {{(pid=88715) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Creating volume glance metadata for volume c6ce96d1-59f1-4b06-b263-543ddb67e2d4 backed by image 7dcc2e22-a3c3-4710-b989-6a1ace96c6d4 with: {'image_id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6f25a02b2c09cfb745c71607d7b50f22', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88715) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 16:06:35 devstack sudo[109402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625 Aug 05 16:06:35 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29f4db-42b7-46dd-ae33-3dd2587880f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4', 'volume_size': 1, 'image_id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f25a02b2c09cfb745c71607d7b50f22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90427b7477094e6d8d0b007dcc37f8e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2bfa54cdb6838519bad5160c79a1c8f427158c4219141b3db7ffadcea0fdce1581c861b4d25d3ffb9021872e3aa4ab5c7621ddfb6282dae0d53422417a6f2763', 'id': '7dcc2e22-a3c3-4710-b989-6a1ace96c6d4', 'created_at': datetime.datetime(2026, 8, 5, 14, 6, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 14, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dcc2e22-a3c3-4710-b989-6a1ace96c6d4/file', 'properties': {}}, 'image_service': }' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0add7db-a4a6-47a8-a2a6-ac39ff08058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Volume volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 (c6ce96d1-59f1-4b06-b263-543ddb67e2d4): created successfully Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0add7db-a4a6-47a8-a2a6-ac39ff08058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Flow 'volume_create_manager' (90e2ee0b-7d64-4e40-ba71-3c4c77f99041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ac8d7e6c-8e2d-41e3-979c-25e7908930e4 tempest-VolumeImageDependencyTests-135347055 None] Created volume successfully. Aug 05 16:06:35 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-25357376-03c2-42b5-9f6e-23580cede625" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-25357376-03c2-42b5-9f6e-23580cede625" released by "delete_volume" :: held 0.867s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:35 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d 1G" returned: 0 in 0.627s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Created reservations ['d36137a6-e741-45b0-9c60-125e6030050b', '93ca2255-fd28-4008-8460-184add2c2173', '428c1a76-db5a-4a8d-8f39-7087c0010e20', 'c10261c0-42b8-442c-9572-99c30998f228'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:35 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d Aug 05 16:06:35 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:35 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:35 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-59eeb885-3e3f-42ed-bd7e-52f536fe047f-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-59eeb885-3e3f-42ed-bd7e-52f536fe047f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8308090e-fe54-4e49-be87-213c48f79a53]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.320s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:36 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Deleted volume successfully. Aug 05 16:06:36 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d" returned: 0 in 0.470s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d is being set with open permissions: ugo+rw Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f109a192-69f8-460c-b287-d28972fdb730 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-25357376-03c2-42b5-9f6e-23580cede625-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:36 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f Aug 05 16:06:36 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:36 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d Aug 05 16:06:36 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Acquiring lock "cinder-c6ce96d1-59f1-4b06-b263-543ddb67e2d4-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "cinder-c6ce96d1-59f1-4b06-b263-543ddb67e2d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:36 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f" returned: 0 in 0.502s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Acquiring lock "cinder-quobyte-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:36 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f Aug 05 16:06:36 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "cinder-quobyte-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1bb4e-0311-4d06-9bb9-50cad89855c5]: (4, 'raw') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info Aug 05 16:06:36 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:36 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:36 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:36 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-59eeb885-3e3f-42ed-bd7e-52f536fe047f" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-quobyte-59eeb885-3e3f-42ed-bd7e-52f536fe047f" released by "delete_volume" :: held 0.857s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Created reservations ['c8f20e5c-49a7-448c-a4e7-e8fe3d645c14', 'e07a2780-5ecf-4f76-a76c-451257988f98', '6f5de6f4-379c-4bae-8f12-c9fd2e8ba297', '5b1c6419-7cd7-4b66-9a05-4c181bea34d6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:36 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info" returned: 0 in 0.309s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:36 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info is being set with open permissions: ugo+rw Aug 05 16:06:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:36 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info Aug 05 16:06:36 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:37 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:37 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:37 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 0 in 0.463s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:37 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:37 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:37 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.info" returned: 0 in 0.356s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2c88201a-03e2-4080-a69e-2140da2d7421 tempest-CinderUnicodeTest-697570496 None] Create snapshot completed successfully Aug 05 16:06:37 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Deleted volume successfully. Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2891ad3c-0e24-425b-a02f-cecb4f664105 tempest-VolumeDependencyTests-778096117 None] Lock "cinder-59eeb885-3e3f-42ed-bd7e-52f536fe047f-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:37 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 1 in 0.432s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4' failed. Not Retrying. {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:37 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4 Aug 05 16:06:37 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-026096c4-739f-458f-9e67-006b459a891d-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-026096c4-739f-458f-9e67-006b459a891d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-quobyte-026096c4-739f-458f-9e67-006b459a891d" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-026096c4-739f-458f-9e67-006b459a891d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Deleting offline snapshot 026096c4-739f-458f-9e67-006b459a891d of volume ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] snapshot_file for this snap is: volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e203afb7-e72d-4396-bfdc-45e3d00f3530]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:37 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" returned: 0 in 0.369s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "cinder-quobyte-c6ce96d1-59f1-4b06-b263-543ddb67e2d4" released by "delete_volume" :: held 1.359s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:37 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d Aug 05 16:06:37 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Created reservations ['a946d0e4-a713-4eb0-998b-7d3b12dc36eb', '8a202bfb-2e53-4a7a-bbb5-a60223f2e5c3', 'faadedb1-de54-4335-81e5-db6d01752b0f', 'a9e3aa2a-0d87-4ff4-8291-88e65ee02b7d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:38 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:38 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:38 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d" returned: 0 in 0.505s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b4a38e-5e36-488d-842b-b0dbb2ac02a4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:38 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.321s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Deleted volume successfully. Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-e0354018-ddf9-44c2-8fbe-7c7f16b26b90 tempest-VolumeImageDependencyTests-135347055 None] Lock "cinder-c6ce96d1-59f1-4b06-b263-543ddb67e2d4-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:38 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc Aug 05 16:06:38 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:38 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" returned: 0 in 0.446s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:38 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d Aug 05 16:06:38 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:39 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d" returned: 0 in 0.438s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:39 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d Aug 05 16:06:39 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:39 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc.026096c4-739f-458f-9e67-006b459a891d" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-026096c4-739f-458f-9e67-006b459a891d" released by "_delete_snapshot" :: held 1.828s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" released by "delete_snapshot" :: held 1.870s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Created reservations ['7157bbee-f143-438f-b46d-ad28116ed7d7', '38386bf6-e1ec-403f-b7bb-f5a67b85c152', '3b49737e-ece9-4a86-9dbe-1db1aeaee906', '2e244a39-312a-49b5-bbde-fd8c39ed62c7'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Delete snapshot completed successfully. Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7e09248d-5a29-469a-8a4e-a864ad8d9c72 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-026096c4-739f-458f-9e67-006b459a891d-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba2c8fe-b7f9-48e7-ab88-255a716e0ffc]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:40 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc Aug 05 16:06:40 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:40 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" returned: 0 in 0.519s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:40 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc Aug 05 16:06:40 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:41 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc" released by "delete_volume" :: held 0.999s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Created reservations ['07488021-220c-4fc5-9352-192eee0346e1', '9ea0a998-5543-42f0-9585-62cb585c45ce', '00c80cc6-e504-4f17-a7a4-8dc24843b624', '41654b97-46ec-4948-9bc4-af2622af3282'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:41 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:41 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:41 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.279s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Deleted volume successfully. Aug 05 16:06:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-814c583d-a5b6-4564-b589-e96b9365cc62 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-ae9b94f1-db9b-42f2-897e-bb9dbdea7bcc-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-79fb2afd-0f17-45bf-bdb9-4891b705cb81-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-79fb2afd-0f17-45bf-bdb9-4891b705cb81-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "cinder-quobyte-79fb2afd-0f17-45bf-bdb9-4891b705cb81" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-79fb2afd-0f17-45bf-bdb9-4891b705cb81" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36ed6df-5d3f-43f9-85cc-3dcd3a19141a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:42 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 Aug 05 16:06:42 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-8800f9b7-8056-4eee-9932-5d4bbc39d97c tempest-ProjectAdminTests-568847933 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6386604309082, 'free_capacity_gb': 1775.6386604309082, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88715) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 16:06:42 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81" returned: 0 in 0.440s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:42 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81 Aug 05 16:06:42 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:43 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-79fb2afd-0f17-45bf-bdb9-4891b705cb81" returned: 0 in 0.340s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-quobyte-79fb2afd-0f17-45bf-bdb9-4891b705cb81" released by "delete_volume" :: held 0.849s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Created reservations ['0fbe8be8-e601-4b21-a008-ba78c28bedb4', 'cfaf98f2-3128-45cb-8b71-ea477d83f998', '6e091eda-2339-4c12-8ddc-905a463723d5', 'ad2b732d-aa8e-45a2-90c2-c4ea2af49db8'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:43 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:43 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:43 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Deleted volume successfully. Aug 05 16:06:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-dc5e30db-d2c7-4400-a7ce-5adc0ab0be52 tempest-CinderUnicodeTest-697570496 None] Lock "cinder-79fb2afd-0f17-45bf-bdb9-4891b705cb81-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (c79c014a-6829-48b7-9a8d-63663db1714a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e06cd2-5af4-4095-aa14-0d5e16afc6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e06cd2-5af4-4095-aa14-0d5e16afc6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384991062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5153e01f-e2d7-420a-a447-4f869f7554d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:48Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ace24-3ad4-4313-b6a1-6a3b444eaad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ace24-3ad4-4313-b6a1-6a3b444eaad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318144e9-1cbd-40cf-891b-6ead638916e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318144e9-1cbd-40cf-891b-6ead638916e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5153e01f-e2d7-420a-a447-4f869f7554d5', 'volume_name': 'volume-5153e01f-e2d7-420a-a447-4f869f7554d5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1def35-ee0d-4df5-8328-63b49cf3d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1def35-ee0d-4df5-8328-63b49cf3d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea95d085-ec8d-475b-b597-3477eab12226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:47 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Volume 5153e01f-e2d7-420a-a447-4f869f7554d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5153e01f-e2d7-420a-a447-4f869f7554d5', 'volume_size': 1} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384991062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5153e01f-e2d7-420a-a447-4f869f7554d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:48Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Creating volume 5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:47 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:48 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 1073741824 Aug 05 16:06:48 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:48 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 1073741824" returned: 0 in 0.634s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:48 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 Aug 05 16:06:48 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:48 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5" returned: 0 in 0.288s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea95d085-ec8d-475b-b597-3477eab12226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5153e01f-e2d7-420a-a447-4f869f7554d5', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c12df9-b4af-4861-8526-b3c66b4b2d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Volume volume-5153e01f-e2d7-420a-a447-4f869f7554d5 (5153e01f-e2d7-420a-a447-4f869f7554d5): created successfully Aug 05 16:06:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c12df9-b4af-4861-8526-b3c66b4b2d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (c79c014a-6829-48b7-9a8d-63663db1714a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3442dd5c-6c05-49ec-9c5c-751b602be97b tempest-ProjectReaderTests-398267675 None] Created volume successfully. Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Creating offline snapshot 9537fe33-34bd-4e46-bac6-2681af3a978d of volume 5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d698b-17e1-4da6-8124-77a67d88202b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:50 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 Aug 05 16:06:50 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:50 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5" returned: 0 in 0.483s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:50 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d 1G Aug 05 16:06:50 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:51 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d 1G" returned: 0 in 0.541s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153e01f-e2d7-420a-a447-4f869f7554d5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:51 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153e01f-e2d7-420a-a447-4f869f7554d5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d Aug 05 16:06:51 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:51 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153e01f-e2d7-420a-a447-4f869f7554d5 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d" returned: 0 in 0.400s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:51 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d is being set with open permissions: ugo+rw Aug 05 16:06:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:51 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d Aug 05 16:06:51 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:52 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d" returned: 0 in 0.281s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:52 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info Aug 05 16:06:52 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:52 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:52 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info is being set with open permissions: ugo+rw Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:52 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info Aug 05 16:06:52 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:52 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.info" returned: 0 in 0.293s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6ee6113c-3a1a-4a82-bd54-c593472f5b53 tempest-ProjectReaderTests-398267675 None] Create snapshot completed successfully Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-9537fe33-34bd-4e46-bac6-2681af3a978d-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-9537fe33-34bd-4e46-bac6-2681af3a978d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-9537fe33-34bd-4e46-bac6-2681af3a978d" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-9537fe33-34bd-4e46-bac6-2681af3a978d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Deleting offline snapshot 9537fe33-34bd-4e46-bac6-2681af3a978d of volume 5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] snapshot_file for this snap is: volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e03d6c-dc98-4cbd-9b69-433d5f3e3804]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:54 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d Aug 05 16:06:54 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=225,cinder:UPDATE=276,cinder:DELETE=24,cinder:INSERT=73 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=286,cinder:SELECT=185,cinder:INSERT=77,cinder:DELETE=27 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (0c34028a-c08e-4102-b12a-4efe987f0165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:54 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402b2a49-7899-4693-99c9-e4fbff128367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d" returned: 0 in 0.534s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5153e01f-e2d7-420a-a447-4f869f7554d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[65032e41-5f12-40e0-9876-68673713757d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402b2a49-7899-4693-99c9-e4fbff128367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171028225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f31634-2a58-4e20-ac39-1dc74d9f1491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:54Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5c70a3-2e6f-48e3-89ed-18b91dd59f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5c70a3-2e6f-48e3-89ed-18b91dd59f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d675fd9-1e32-4a7f-b96e-14001f84d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d675fd9-1e32-4a7f-b96e-14001f84d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f31634-2a58-4e20-ac39-1dc74d9f1491', 'volume_name': 'volume-34f31634-2a58-4e20-ac39-1dc74d9f1491', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f712ca-4866-4bae-924d-3507172a2fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f712ca-4866-4bae-924d-3507172a2fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa97740-b558-4e41-b23f-6dd21feb0145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:54 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Volume 34f31634-2a58-4e20-ac39-1dc74d9f1491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f31634-2a58-4e20-ac39-1dc74d9f1491', 'volume_size': 1} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171028225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f31634-2a58-4e20-ac39-1dc74d9f1491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:54Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Creating volume 34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:54 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:54 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 1073741824 Aug 05 16:06:54 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:54 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 Aug 05 16:06:54 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:54 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5" returned: 0 in 0.453s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:55 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d Aug 05 16:06:55 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:55 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 1073741824" returned: 0 in 0.612s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:55 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 Aug 05 16:06:55 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:55 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d" returned: 0 in 0.548s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:55 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d Aug 05 16:06:55 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:55 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491" returned: 0 in 0.336s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa97740-b558-4e41-b23f-6dd21feb0145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f31634-2a58-4e20-ac39-1dc74d9f1491', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c35cd3-cb62-4794-b11c-bedb22a391ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:55 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Volume volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 (34f31634-2a58-4e20-ac39-1dc74d9f1491): created successfully Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c35cd3-cb62-4794-b11c-bedb22a391ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (0c34028a-c08e-4102-b12a-4efe987f0165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-13b4633e-85e8-4f4a-bbf6-2c06396dda88 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:06:55 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5.9537fe33-34bd-4e46-bac6-2681af3a978d" returned: 0 in 0.263s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-9537fe33-34bd-4e46-bac6-2681af3a978d" released by "_delete_snapshot" :: held 1.998s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" released by "delete_snapshot" :: held 2.026s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Created reservations ['dae4dcff-ec32-4e02-9445-b3c37127ab25', '83fd61d7-3274-4147-adb4-a1aabd19f7aa', '8f04f0dc-7555-4fda-8c68-bafa4e818f81', '1eb5e475-8c88-4e56-977b-017c2cdfcc7e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Delete snapshot completed successfully. Aug 05 16:06:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f049c2bf-0d27-4c7a-8824-447a60181ac5 tempest-ProjectReaderTests-398267675 None] Lock "cinder-9537fe33-34bd-4e46-bac6-2681af3a978d-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-5153e01f-e2d7-420a-a447-4f869f7554d5-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "cinder-5153e01f-e2d7-420a-a447-4f869f7554d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ec6c0-debb-42be-ae63-e5bc2eeca8d1]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:56 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 Aug 05 16:06:56 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:56 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:56 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5 Aug 05 16:06:56 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:56 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-5153e01f-e2d7-420a-a447-4f869f7554d5" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-5153e01f-e2d7-420a-a447-4f869f7554d5" released by "delete_volume" :: held 0.856s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot 522f876b-6322-4670-8243-803bac9ad567 of volume 34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[19779982-a975-4aa8-9db8-ccb5ecacc94c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Created reservations ['b7e2a8f8-330e-46b5-911e-e69f76107907', 'bc03abd3-1a95-45ac-87c2-d6ae1dc7bb3a', '2a2356cb-e0f8-4d4c-ade6-495c7f3d9263', 'dd8c2da0-03b1-412a-ac1c-105c18081ec3'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:57 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 Aug 05 16:06:57 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:57 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:06:57 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:57 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:06:57 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Deleted volume successfully. Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491" returned: 0 in 0.608s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-5a64a88e-6248-4cf5-b3a0-148524ce816d tempest-ProjectReaderTests-398267675 None] Lock "cinder-5153e01f-e2d7-420a-a447-4f869f7554d5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:06:57 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 1G Aug 05 16:06:57 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (e35d67e7-40db-49ac-8b7b-25401868cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794fb173-108d-499d-a860-e220b2667218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794fb173-108d-499d-a860-e220b2667218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274663795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1885d0bd-9028-4f43-9a51-5199486b4ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:58Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e62c5f0-3232-4773-a9b0-183cbfdd04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e62c5f0-3232-4773-a9b0-183cbfdd04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1c6cec-ba0e-4a17-9b6c-835b245d82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1c6cec-ba0e-4a17-9b6c-835b245d82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1885d0bd-9028-4f43-9a51-5199486b4ec1', 'volume_name': 'volume-1885d0bd-9028-4f43-9a51-5199486b4ec1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55c30ee-007d-4fa4-9164-f255bc5234ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55c30ee-007d-4fa4-9164-f255bc5234ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9665ac45-b80d-4045-8311-72f57a5942be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:06:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Volume 1885d0bd-9028-4f43-9a51-5199486b4ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1885d0bd-9028-4f43-9a51-5199486b4ec1', 'volume_size': 1} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:58 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 1G" returned: 0 in 0.566s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:58 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 Aug 05 16:06:58 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:58 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567" returned: 0 in 0.318s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:58 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 is being set with open permissions: ugo+rw Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:58 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 Aug 05 16:06:58 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:58 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:58 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info Aug 05 16:06:58 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:59 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:59 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info is being set with open permissions: ugo+rw Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:59 devstack sudo[109639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info Aug 05 16:06:59 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:59 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.info" returned: 0 in 0.346s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274663795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1885d0bd-9028-4f43-9a51-5199486b4ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:06:58Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Creating volume 1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:06:59 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:06:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:06:59 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 1073741824 Aug 05 16:06:59 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:06:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ee091ba3-b7c8-405d-8f8b-d4d2849960c2 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:00 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 1073741824" returned: 0 in 0.498s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:00 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 Aug 05 16:07:00 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-522f876b-6322-4670-8243-803bac9ad567-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-522f876b-6322-4670-8243-803bac9ad567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-522f876b-6322-4670-8243-803bac9ad567" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-522f876b-6322-4670-8243-803bac9ad567" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot 522f876b-6322-4670-8243-803bac9ad567 of volume 34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5115d565-c97c-442b-a253-18fd05775b9a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:00 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 Aug 05 16:07:00 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:00 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9665ac45-b80d-4045-8311-72f57a5942be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1885d0bd-9028-4f43-9a51-5199486b4ec1', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f8898-4c5b-42c5-83a3-4e419aa6e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:00 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Volume volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 (1885d0bd-9028-4f43-9a51-5199486b4ec1): created successfully Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f8898-4c5b-42c5-83a3-4e419aa6e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (e35d67e7-40db-49ac-8b7b-25401868cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:00 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-443d498e-f307-4826-ba21-d21628565f17 tempest-ProjectReaderTests-398267675 None] Created volume successfully. Aug 05 16:07:00 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567" returned: 0 in 0.507s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f31634-2a58-4e20-ac39-1dc74d9f1491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[26433c0c-4f48-4806-89a9-54e71174b2ac]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:01 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 Aug 05 16:07:01 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:01 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491" returned: 0 in 0.560s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:01 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 Aug 05 16:07:01 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Creating offline snapshot 675c8016-4f87-41fb-8337-667ccb3b7f24 of volume 1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572b1a4-b259-4240-8690-3722c59699b6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:01 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 Aug 05 16:07:01 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:01 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567" returned: 0 in 0.439s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:01 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567 Aug 05 16:07:01 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:01 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1" returned: 0 in 0.465s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:01 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 1G Aug 05 16:07:01 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:02 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491.522f876b-6322-4670-8243-803bac9ad567" returned: 0 in 0.283s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-522f876b-6322-4670-8243-803bac9ad567" released by "_delete_snapshot" :: held 1.958s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" released by "delete_snapshot" :: held 2.001s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Created reservations ['9d41e5ac-2cff-4c43-8e6c-a11da49b11f1', '0319a8b7-1cdb-4e42-909a-d17bcdad2c20', 'c9aed062-288d-42d5-8b37-0376098127fe', 'ef8225fa-8228-413f-91af-58c795d41e49'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:02 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53a3d0a5-82c1-4b57-8693-20d2cf7283b5 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-522f876b-6322-4670-8243-803bac9ad567-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:02 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 1G" returned: 0 in 0.457s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:02 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 Aug 05 16:07:02 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:02 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:02 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 is being set with open permissions: ugo+rw Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:02 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 Aug 05 16:07:02 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:02 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:03 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info Aug 05 16:07:03 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:03 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info" returned: 0 in 0.307s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:03 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info is being set with open permissions: ugo+rw Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:03 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info Aug 05 16:07:03 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-34f31634-2a58-4e20-ac39-1dc74d9f1491-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-34f31634-2a58-4e20-ac39-1dc74d9f1491-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c12b29-79b2-4f65-9f2a-9aab7eb22bc9]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:03 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.info" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:03 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 Aug 05 16:07:03 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:03 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:03 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b888dabc-1fd4-4995-a8c6-fd94e3250d08 tempest-ProjectReaderTests-398267675 None] Create snapshot completed successfully Aug 05 16:07:03 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.295s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:07:04 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:04 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491 Aug 05 16:07:04 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:04 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-34f31634-2a58-4e20-ac39-1dc74d9f1491" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-34f31634-2a58-4e20-ac39-1dc74d9f1491" released by "delete_volume" :: held 0.750s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Created reservations ['7ab55c83-1236-4a36-bd96-d3ef58cf2d86', '3609ec2b-a4cc-461a-8d14-d231ad69d7c3', '682295da-cf5f-4666-89e2-42ccb3ed9c01', 'bddc46ea-3078-4f9a-89bc-778856476e7d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:04 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:04 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-675c8016-4f87-41fb-8337-667ccb3b7f24-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-675c8016-4f87-41fb-8337-667ccb3b7f24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-675c8016-4f87-41fb-8337-667ccb3b7f24" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-675c8016-4f87-41fb-8337-667ccb3b7f24" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Deleting offline snapshot 675c8016-4f87-41fb-8337-667ccb3b7f24 of volume 1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] snapshot_file for this snap is: volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5551584f-a1da-4149-87e7-db4419897ced]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:04 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.408s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:04 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:04 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 Aug 05 16:07:04 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-b20bfdcb-7655-45d2-83d1-1dfba82523c9 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-34f31634-2a58-4e20-ac39-1dc74d9f1491-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:05 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24" returned: 0 in 0.489s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1885d0bd-9028-4f43-9a51-5199486b4ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a0449e-6ed3-4cde-9a4e-85aaa07ebd91]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e76f4bb1-c285-44bd-8507-ac523e5fb679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79dfde9-99d2-4041-a5fe-a546120d860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79dfde9-99d2-4041-a5fe-a546120d860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315736213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d0d3db-4512-4cf1-b978-532125f6f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:05Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cbf129-6387-4767-93e6-0a1d22199421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cbf129-6387-4767-93e6-0a1d22199421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5ce9fd-b527-4528-a365-d6940237d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5ce9fd-b527-4528-a365-d6940237d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d0d3db-4512-4cf1-b978-532125f6f651', 'volume_name': 'volume-e5d0d3db-4512-4cf1-b978-532125f6f651', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77e87d3-0f55-43f7-9e0d-d6763182c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77e87d3-0f55-43f7-9e0d-d6763182c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:05 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 Aug 05 16:07:05 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cab3d0a-3495-4bc3-8933-49e106883c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Volume e5d0d3db-4512-4cf1-b978-532125f6f651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d0d3db-4512-4cf1-b978-532125f6f651', 'volume_size': 1} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315736213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d0d3db-4512-4cf1-b978-532125f6f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:05Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Creating volume e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:05 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:05 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 1073741824 Aug 05 16:07:05 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:05 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1" returned: 0 in 0.466s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:05 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 Aug 05 16:07:05 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:05 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 1073741824" returned: 0 in 0.571s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:06 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 Aug 05 16:07:06 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:06 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24" returned: 0 in 0.490s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:06 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24 Aug 05 16:07:06 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:06 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cab3d0a-3495-4bc3-8933-49e106883c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d0d3db-4512-4cf1-b978-532125f6f651', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d379bd8f-4392-450a-98d9-faeed331325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:06 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Volume volume-e5d0d3db-4512-4cf1-b978-532125f6f651 (e5d0d3db-4512-4cf1-b978-532125f6f651): created successfully Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d379bd8f-4392-450a-98d9-faeed331325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e76f4bb1-c285-44bd-8507-ac523e5fb679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e001ba6b-1e9f-4ca9-9d65-3ec41c2c3db3 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:06 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1.675c8016-4f87-41fb-8337-667ccb3b7f24" returned: 0 in 0.304s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-675c8016-4f87-41fb-8337-667ccb3b7f24" released by "_delete_snapshot" :: held 1.878s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" released by "delete_snapshot" :: held 1.910s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Created reservations ['73792d32-1ea9-4b7d-b6e3-854607ad6302', 'b3753445-9045-4903-876b-a9d0e82524ce', '25c0ef1a-675b-4eae-9ccc-254c694e40de', 'baa6c56a-f095-4095-af93-61f15b8b5be9'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Delete snapshot completed successfully. Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a1a2816c-0256-48c1-a9ac-e0d79bc4365e tempest-ProjectReaderTests-398267675 None] Lock "cinder-675c8016-4f87-41fb-8337-667ccb3b7f24-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-1885d0bd-9028-4f43-9a51-5199486b4ec1-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "cinder-1885d0bd-9028-4f43-9a51-5199486b4ec1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b524f-03f1-4b57-b72c-110e67e37303]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:07 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 Aug 05 16:07:07 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:07 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1" returned: 0 in 0.425s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:07 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1 Aug 05 16:07:07 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot da3802c3-7f50-4855-8364-0993134d8e58 of volume e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9dc09-1e61-4770-b53a-43c70c8176f7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:07 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-1885d0bd-9028-4f43-9a51-5199486b4ec1" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-1885d0bd-9028-4f43-9a51-5199486b4ec1" released by "delete_volume" :: held 0.822s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Created reservations ['f78ffb2c-1e10-49ca-bff5-faf5a897d1d6', '6fb8c617-ddca-4c34-b7d4-a54cfe9037c7', '4c4feae5-4c03-4d91-850c-050d447f8b9e', 'b749d701-f8fc-4e58-982e-2644585023f1'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:07 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 Aug 05 16:07:07 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:07 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:07 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:08 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651" returned: 0 in 0.523s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:08 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 1G Aug 05 16:07:08 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:08 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Deleted volume successfully. Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-da5e298d-ff66-4b99-9047-5c63ab9c5140 tempest-ProjectReaderTests-398267675 None] Lock "cinder-1885d0bd-9028-4f43-9a51-5199486b4ec1-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (5f2aae8c-ecf6-405d-a287-90b97540b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77ecd1-ba53-4fd8-b196-93fedd097de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a77ecd1-ba53-4fd8-b196-93fedd097de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948867555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed69852-efff-4437-9ce5-f945c2fca5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:09Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f32bd-0608-498b-8c42-9eac6c3a1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f32bd-0608-498b-8c42-9eac6c3a1c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba22ab-efed-4a1d-ab11-6d3625071684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba22ab-efed-4a1d-ab11-6d3625071684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed69852-efff-4437-9ce5-f945c2fca5c3', 'volume_name': 'volume-8ed69852-efff-4437-9ce5-f945c2fca5c3', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7dcf171-4f5b-462d-881e-0c6d13b2af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7dcf171-4f5b-462d-881e-0c6d13b2af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490fbb04-131a-4dea-97b4-cf785a46de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:08 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Volume 8ed69852-efff-4437-9ce5-f945c2fca5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed69852-efff-4437-9ce5-f945c2fca5c3', 'volume_size': 1} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:08 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 1G" returned: 0 in 0.709s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0d3db-4512-4cf1-b978-532125f6f651 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:08 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0d3db-4512-4cf1-b978-532125f6f651 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 Aug 05 16:07:08 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:09 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0d3db-4512-4cf1-b978-532125f6f651 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:09 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 is being set with open permissions: ugo+rw Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:09 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 Aug 05 16:07:09 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:09 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:09 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info Aug 05 16:07:09 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:09 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info" returned: 0 in 0.291s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:09 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info is being set with open permissions: ugo+rw Aug 05 16:07:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:09 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info Aug 05 16:07:09 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:10 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.info" returned: 0 in 0.256s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948867555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed69852-efff-4437-9ce5-f945c2fca5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:09Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Creating volume 8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:10 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:10 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 1073741824 Aug 05 16:07:10 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-06b881a0-3bf8-47aa-838f-341618be4247 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:10 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 1073741824" returned: 0 in 0.488s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:10 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 Aug 05 16:07:10 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-da3802c3-7f50-4855-8364-0993134d8e58-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-da3802c3-7f50-4855-8364-0993134d8e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-da3802c3-7f50-4855-8364-0993134d8e58" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-da3802c3-7f50-4855-8364-0993134d8e58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot da3802c3-7f50-4855-8364-0993134d8e58 of volume e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f418426-c898-4bf9-be62-60f636fd745d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:10 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490fbb04-131a-4dea-97b4-cf785a46de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed69852-efff-4437-9ce5-f945c2fca5c3', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ea2dca-d23f-442a-80a8-6bbe176ae78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:10 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Volume volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 (8ed69852-efff-4437-9ce5-f945c2fca5c3): created successfully Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ea2dca-d23f-442a-80a8-6bbe176ae78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:10 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (5f2aae8c-ecf6-405d-a287-90b97540b26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:11 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1a519803-a4c0-4e79-a4b9-a1e7baf69d7c tempest-ProjectReaderTests-398267675 None] Created volume successfully. Aug 05 16:07:11 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 Aug 05 16:07:11 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:11 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d0d3db-4512-4cf1-b978-532125f6f651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[857cc2b9-107f-42f3-bacc-b7920f09b39f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:11 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 Aug 05 16:07:11 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:11 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651" returned: 0 in 0.376s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:11 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 Aug 05 16:07:11 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Creating offline snapshot 7f2353b4-a31a-46d7-ac31-f2314176951f of volume 8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[c257cae5-00d1-4e61-8ee1-f14794794073]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:12 devstack sudo[109799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 Aug 05 16:07:12 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:12 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58" returned: 0 in 0.409s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:12 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58 Aug 05 16:07:12 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:12 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3" returned: 0 in 0.401s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:12 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651.da3802c3-7f50-4855-8364-0993134d8e58" returned: 0 in 0.268s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:12 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f 1G Aug 05 16:07:12 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-da3802c3-7f50-4855-8364-0993134d8e58" released by "_delete_snapshot" :: held 1.601s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" released by "delete_snapshot" :: held 1.628s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Created reservations ['a2780705-a13a-4780-be84-9b9873147ac6', 'a0aecbc6-d045-4044-84a3-34e3cc8ab2e8', 'ce47731e-7f07-45c0-9832-e440939bb203', '75f3eacb-17f8-4d03-8d90-8c5d6e2d72e0'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-0ec1b84c-a3c5-4c0a-a787-28877298b272 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-da3802c3-7f50-4855-8364-0993134d8e58-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:12 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f 1G" returned: 0 in 0.403s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:12 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f Aug 05 16:07:12 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-e5d0d3db-4512-4cf1-b978-532125f6f651-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-e5d0d3db-4512-4cf1-b978-532125f6f651-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:13 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:13 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f is being set with open permissions: ugo+rw Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc17b30-5675-4ee2-9288-67f225ebe900]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:13 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f Aug 05 16:07:13 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 Aug 05 16:07:13 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f" returned: 0 in 0.298s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:13 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info Aug 05 16:07:13 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651" returned: 0 in 0.458s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:13 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651 Aug 05 16:07:13 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:13 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info is being set with open permissions: ugo+rw Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:13 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info Aug 05 16:07:13 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:13 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-e5d0d3db-4512-4cf1-b978-532125f6f651" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-e5d0d3db-4512-4cf1-b978-532125f6f651" released by "delete_volume" :: held 0.805s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:13 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Created reservations ['dd34b350-137c-4fa2-93db-d43facf34fd6', '0c212d84-1e8a-406b-a4c3-cff91a5c91bd', '8df9b45c-7067-4dc8-a5e2-b5a2ed7d0843', '8a16f7a3-ea79-49fe-91c6-a4c2e432aa78'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:14 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.info" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:14 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:14 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6cfaeac0-59df-4eed-bb0b-b59ea417a224 tempest-ProjectReaderTests-398267675 None] Create snapshot completed successfully Aug 05 16:07:14 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:14 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6df38cd8-b972-41a9-9ece-cca4954257d1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-e5d0d3db-4512-4cf1-b978-532125f6f651-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (1327acf1-a1d4-48e2-9b70-80f170ee1ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835813c-da30-4b4d-8526-4c3b9428b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835813c-da30-4b4d-8526-4c3b9428b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671613438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796403cf-600f-4eb7-8574-0d5c9a0d7f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:15Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3420df2-7049-4053-b97e-22041382c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3420df2-7049-4053-b97e-22041382c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9cccbf-280c-4960-88bc-4364fa0f0d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9cccbf-280c-4960-88bc-4364fa0f0d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796403cf-600f-4eb7-8574-0d5c9a0d7f59', 'volume_name': 'volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3136d3e-82f2-4cdb-b4bc-fc300ce04008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3136d3e-82f2-4cdb-b4bc-fc300ce04008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1c850a-96f9-4480-bcf1-3b67ffa8e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:14 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Volume 796403cf-600f-4eb7-8574-0d5c9a0d7f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59', 'volume_size': 1} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1671613438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796403cf-600f-4eb7-8574-0d5c9a0d7f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:15Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Creating volume 796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:14 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:14 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 1073741824 Aug 05 16:07:14 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-7f2353b4-a31a-46d7-ac31-f2314176951f-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-7f2353b4-a31a-46d7-ac31-f2314176951f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-7f2353b4-a31a-46d7-ac31-f2314176951f" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-7f2353b4-a31a-46d7-ac31-f2314176951f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Deleting offline snapshot 7f2353b4-a31a-46d7-ac31-f2314176951f of volume 8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] snapshot_file for this snap is: volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f72f47-e278-4e1b-9809-d8345e3fc9d2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:15 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f Aug 05 16:07:15 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:15 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 1073741824" returned: 0 in 0.548s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:15 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 Aug 05 16:07:15 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:15 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:15 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59" returned: 0 in 0.289s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f" returned: 0 in 0.492s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ed69852-efff-4437-9ce5-f945c2fca5c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a68ee-519e-4d6a-b5e2-a73d6f060249]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1c850a-96f9-4480-bcf1-3b67ffa8e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b1ca7-cc58-44e4-aa36-18d5c6f52f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:15 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Volume volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 (796403cf-600f-4eb7-8574-0d5c9a0d7f59): created successfully Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b1ca7-cc58-44e4-aa36-18d5c6f52f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:15 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (1327acf1-a1d4-48e2-9b70-80f170ee1ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-84393e11-31eb-4e03-89f8-70bc6c81368b tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:15 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 Aug 05 16:07:15 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:16 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3" returned: 0 in 0.404s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:16 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f Aug 05 16:07:16 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:16 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f" returned: 0 in 0.432s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:16 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f Aug 05 16:07:16 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:16 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3.7f2353b4-a31a-46d7-ac31-f2314176951f" returned: 0 in 0.315s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-7f2353b4-a31a-46d7-ac31-f2314176951f" released by "_delete_snapshot" :: held 1.769s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" released by "delete_snapshot" :: held 1.803s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot f5170268-b2fb-44b4-877e-392a9c25ad10 of volume 796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[63defbd1-9ccf-4b74-9e7a-96aedd47585d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Created reservations ['bbc6c022-0b25-49cb-8703-02948b3527f5', '29ea0332-806c-48bc-a445-4c10c1d2dbdf', '668611a1-30d3-4b6a-9210-e6a149cd205f', '0a30ccd1-c78e-4589-9c6c-b964a49135f2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Delete snapshot completed successfully. Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-3ebf06e2-ed5c-47c3-894a-7bdd6749245d tempest-ProjectReaderTests-398267675 None] Lock "cinder-7f2353b4-a31a-46d7-ac31-f2314176951f-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:17 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 Aug 05 16:07:17 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-8ed69852-efff-4437-9ce5-f945c2fca5c3-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "cinder-8ed69852-efff-4437-9ce5-f945c2fca5c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b1a02-b569-4cb0-87b5-d0a5c4e6f30a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:17 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59" returned: 0 in 0.556s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:17 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 Aug 05 16:07:17 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:17 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 1G Aug 05 16:07:17 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:17 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3" returned: 0 in 0.412s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:17 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3 Aug 05 16:07:17 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:18 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 1G" returned: 0 in 0.477s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:18 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 Aug 05 16:07:18 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:18 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8ed69852-efff-4437-9ce5-f945c2fca5c3" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-8ed69852-efff-4437-9ce5-f945c2fca5c3" released by "delete_volume" :: held 0.774s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Created reservations ['314ef091-56c3-4a2b-bd88-8d77b2d55812', '317c0b0d-05cc-4159-a46c-98a91e4c2a23', '29d05075-66cf-4709-9a8b-27eece14139a', '6f0ac34e-d227-486f-8e36-06159b34c626'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:18 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:18 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:18 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10" returned: 0 in 0.392s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:18 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 is being set with open permissions: ugo+rw Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:18 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 Aug 05 16:07:18 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:18 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10" returned: 0 in 0.309s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:18 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info Aug 05 16:07:18 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:18 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.535s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:18 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Deleted volume successfully. Aug 05 16:07:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-7ff82475-3bdb-490c-b326-a94af8a0fd89 tempest-ProjectReaderTests-398267675 None] Lock "cinder-8ed69852-efff-4437-9ce5-f945c2fca5c3-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:19 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info" returned: 0 in 0.357s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:19 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info is being set with open permissions: ugo+rw Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:19 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info Aug 05 16:07:19 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (807a078d-b7c4-44a3-a3ea-3687404ebfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb050e53-016f-4dd5-9e60-82b8c6da50ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb050e53-016f-4dd5-9e60-82b8c6da50ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724868801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa89db1-3c5c-4b54-8c22-83154c2caec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:19Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d7671-9a9d-46c6-aa9f-2bbee90a6d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d7671-9a9d-46c6-aa9f-2bbee90a6d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2144f96d-87ce-44ca-aa71-d0cefb8d3545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2144f96d-87ce-44ca-aa71-d0cefb8d3545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa89db1-3c5c-4b54-8c22-83154c2caec0', 'volume_name': 'volume-faa89db1-3c5c-4b54-8c22-83154c2caec0', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e12de95-4070-47bc-8ee3-0121a7d82046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e12de95-4070-47bc-8ee3-0121a7d82046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dabfedb-fc09-4d0d-aab6-1ee43a8da4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:19 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Volume faa89db1-3c5c-4b54-8c22-83154c2caec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa89db1-3c5c-4b54-8c22-83154c2caec0', 'volume_size': 1} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:19 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.info" returned: 0 in 0.281s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-724868801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa89db1-3c5c-4b54-8c22-83154c2caec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:19Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Creating volume faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:19 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:19 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 1073741824 Aug 05 16:07:19 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e20e7614-bbe8-4dd7-828f-468cebe5aeb5 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:19 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Flow 'volume_create_manager' (61d6aa06-f51b-4ab3-960c-1241b3f1718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1683a1-a698-4ea6-bfbb-4ac029cca0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1683a1-a698-4ea6-bfbb-4ac029cca0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1566558464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a90948-2058-458b-99e8-354a56041521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8b75c22ec4c75b7702baee959bda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:20Z,use_quota=True,user_id='47b6ecedfc52434488313a8c34e1bdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b5a3bd-e9ae-44a7-90f7-952c5535d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b5a3bd-e9ae-44a7-90f7-952c5535d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0b2aaf-1c2a-4b6b-a652-96b651f46e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0b2aaf-1c2a-4b6b-a652-96b651f46e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a90948-2058-458b-99e8-354a56041521', 'volume_name': 'volume-77a90948-2058-458b-99e8-354a56041521', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01c4f82-4208-4e6f-b66e-4d6da8d8a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01c4f82-4208-4e6f-b66e-4d6da8d8a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c148c4c-653f-456e-9f9e-91f5fe487328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Volume 77a90948-2058-458b-99e8-354a56041521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a90948-2058-458b-99e8-354a56041521', 'volume_size': 1} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 1073741824" returned: 0 in 0.552s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:20 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 Aug 05 16:07:20 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-f5170268-b2fb-44b4-877e-392a9c25ad10-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-f5170268-b2fb-44b4-877e-392a9c25ad10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-f5170268-b2fb-44b4-877e-392a9c25ad10" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-f5170268-b2fb-44b4-877e-392a9c25ad10" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot f5170268-b2fb-44b4-877e-392a9c25ad10 of volume 796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[067001be-ccf4-4609-9df4-d0753b9dd957]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:20 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0" returned: 0 in 0.287s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1566558464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a90948-2058-458b-99e8-354a56041521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8b75c22ec4c75b7702baee959bda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:20Z,use_quota=True,user_id='47b6ecedfc52434488313a8c34e1bdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Creating volume 77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:20 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dabfedb-fc09-4d0d-aab6-1ee43a8da4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa89db1-3c5c-4b54-8c22-83154c2caec0', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 1073741824 Aug 05 16:07:20 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c64312b-2868-45d0-80a8-ba4e04542f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:20 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Volume volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 (faa89db1-3c5c-4b54-8c22-83154c2caec0): created successfully Aug 05 16:07:20 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 Aug 05 16:07:20 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c64312b-2868-45d0-80a8-ba4e04542f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (807a078d-b7c4-44a3-a3ea-3687404ebfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:20 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e4d72220-7936-4454-8933-f308c0931384 tempest-ProjectReaderTests-398267675 None] Created volume successfully. Aug 05 16:07:20 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10" returned: 0 in 0.387s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ea54a4-d043-4f88-a0e7-5a98fc326e7d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:20 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 1073741824" returned: 0 in 0.426s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:20 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 Aug 05 16:07:20 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:20 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:20 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:20 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:21 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.256s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:21 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c148c4c-653f-456e-9f9e-91f5fe487328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a90948-2058-458b-99e8-354a56041521', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:21 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304aa251-28cf-4fc0-8191-53599013723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:21 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:21 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Volume volume-77a90948-2058-458b-99e8-354a56041521 (77a90948-2058-458b-99e8-354a56041521): created successfully Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304aa251-28cf-4fc0-8191-53599013723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Flow 'volume_create_manager' (61d6aa06-f51b-4ab3-960c-1241b3f1718f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-429f94da-cb7d-48bb-b248-1d1adbae8e52 tempest-SnapshotDependencyTests-481849125 None] Created volume successfully. Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Creating offline snapshot c45f2140-3932-4cb4-b5c8-9ecb01515ac3 of volume faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:21 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90dc9d4-bb2a-4e71-a9fa-1601947d7d2d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:21 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10 Aug 05 16:07:21 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:21 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 Aug 05 16:07:21 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:21 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59.f5170268-b2fb-44b4-877e-392a9c25ad10" returned: 0 in 0.253s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-f5170268-b2fb-44b4-877e-392a9c25ad10" released by "_delete_snapshot" :: held 1.534s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" released by "delete_snapshot" :: held 1.556s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Created reservations ['0d0a029a-4beb-4449-b19f-276ebbb3ffaa', '2db03830-b60c-4248-bbee-b3d17e1ad777', '2cc70eda-b9e4-4d47-be13-ef4e5f0c58af', 'c62a2173-891d-480f-ae9d-de9519cef9fb'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:21 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0" returned: 0 in 0.361s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:21 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 1G Aug 05 16:07:21 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:21 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:21 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c89ccf9c-c8ed-496e-9f9b-07f51e246c62 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-f5170268-b2fb-44b4-877e-392a9c25ad10-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:22 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 1G" returned: 0 in 0.451s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-796403cf-600f-4eb7-8574-0d5c9a0d7f59-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:22 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 Aug 05 16:07:22 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-796403cf-600f-4eb7-8574-0d5c9a0d7f59-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" acquired by "delete_volume" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db25f0b-1336-4847-a9bf-c0b422f13837]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:22 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 Aug 05 16:07:22 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:22 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3" returned: 0 in 0.302s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:22 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 is being set with open permissions: ugo+rw Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:22 devstack sudo[109963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 Aug 05 16:07:22 devstack sudo[109963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:22 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59" returned: 0 in 0.363s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:22 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59 Aug 05 16:07:22 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:22 devstack sudo[109963]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:22 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:22 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info Aug 05 16:07:22 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:23 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-796403cf-600f-4eb7-8574-0d5c9a0d7f59" returned: 0 in 0.248s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-796403cf-600f-4eb7-8574-0d5c9a0d7f59" released by "delete_volume" :: held 0.679s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Created reservations ['6f667bcb-3e1d-4ca4-8047-e816234f2f35', 'e78b021d-88b2-4dc3-9470-03f99f4cb20a', '7a57fefa-b9ed-4807-846e-c6934fc0a93b', '56e13eed-526b-4aa8-9e4c-6ed2324f1a4f'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:23 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:23 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info is being set with open permissions: ugo+rw Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:23 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info Aug 05 16:07:23 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:23 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:23 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:23 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.info" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.206s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Creating offline snapshot 07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 of volume 77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9485c393-c590-4a83-b454-7ffda70631c4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d45dab61-356b-4744-a36e-ad4eac07bdeb tempest-ProjectReaderTests-398267675 None] Create snapshot completed successfully Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:23 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:23 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-25c0cd01-4aff-437e-9ca8-aa5519cdc292 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-796403cf-600f-4eb7-8574-0d5c9a0d7f59-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-c45f2140-3932-4cb4-b5c8-9ecb01515ac3-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:23 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:23 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-c45f2140-3932-4cb4-b5c8-9ecb01515ac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-c45f2140-3932-4cb4-b5c8-9ecb01515ac3" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-c45f2140-3932-4cb4-b5c8-9ecb01515ac3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Deleting offline snapshot c45f2140-3932-4cb4-b5c8-9ecb01515ac3 of volume faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] snapshot_file for this snap is: volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca7ebc-27f9-4aef-b46e-48266069fc65]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:23 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 Aug 05 16:07:23 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:23 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.425s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 1G Aug 05 16:07:24 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e41e900b-58a5-42ac-b533-cba002e332c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06412142-8e31-4b92-93a2-96c108c7daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06412142-8e31-4b92-93a2-96c108c7daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843067841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d9357-8cd3-41ba-98ce-cc82f9d33795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:24Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3fd242-d843-4879-9682-785171b49ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3fd242-d843-4879-9682-785171b49ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edec7b2-40b9-42d0-ab6f-44e3a2261570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edec7b2-40b9-42d0-ab6f-44e3a2261570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934d9357-8cd3-41ba-98ce-cc82f9d33795', 'volume_name': 'volume-934d9357-8cd3-41ba-98ce-cc82f9d33795', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:24 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3691faa-37a9-485e-8d7e-ea77762d4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3691faa-37a9-485e-8d7e-ea77762d4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facb0078-2ca8-4b11-93a8-f89b8c5be031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Volume 934d9357-8cd3-41ba-98ce-cc82f9d33795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934d9357-8cd3-41ba-98ce-cc82f9d33795', 'volume_size': 1} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3" returned: 0 in 0.432s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faa89db1-3c5c-4b54-8c22-83154c2caec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb0bbd-f91a-4bb3-b759-9a33ccc9e1c3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 Aug 05 16:07:24 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:24 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 1G" returned: 0 in 0.442s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a90948-2058-458b-99e8-354a56041521 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a90948-2058-458b-99e8-354a56041521 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:24 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:24 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0" returned: 0 in 0.373s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 Aug 05 16:07:24 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:24 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a90948-2058-458b-99e8-354a56041521 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.301s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 is being set with open permissions: ugo+rw Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:24 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:24 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3" returned: 0 in 0.341s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:24 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.260s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:24 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3 Aug 05 16:07:24 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:25 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info Aug 05 16:07:25 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:25 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0.c45f2140-3932-4cb4-b5c8-9ecb01515ac3" returned: 0 in 0.254s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-c45f2140-3932-4cb4-b5c8-9ecb01515ac3" released by "_delete_snapshot" :: held 1.510s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" released by "delete_snapshot" :: held 1.535s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:25 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Created reservations ['5508b12a-2229-4154-97e6-4b90cadf8b8b', '204d8f0b-0773-482d-9c05-989bfd1e55e7', '17b1fab0-6bc5-4be2-9c97-55fcad363980', '8f437591-1c99-49fe-a16a-7b7d5365d20e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:25 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info is being set with open permissions: ugo+rw Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:25 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info Aug 05 16:07:25 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Delete snapshot completed successfully. Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-95115cbb-356b-49a7-8bf9-ba2a77fc87cc tempest-ProjectReaderTests-398267675 None] Lock "cinder-c45f2140-3932-4cb4-b5c8-9ecb01515ac3-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:25 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.info" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843067841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d9357-8cd3-41ba-98ce-cc82f9d33795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:24Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Creating volume 934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:25 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:25 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 1073741824 Aug 05 16:07:25 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-eca69ac3-5cc5-4b4f-b7f1-591899ddb771 tempest-SnapshotDependencyTests-481849125 None] Create snapshot completed successfully Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-faa89db1-3c5c-4b54-8c22-83154c2caec0-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "cinder-faa89db1-3c5c-4b54-8c22-83154c2caec0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffe94b-02db-48cd-bd05-cc31a66acd7e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:26 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 1073741824" returned: 0 in 0.454s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:26 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 Aug 05 16:07:26 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:26 devstack sudo[110032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 Aug 05 16:07:26 devstack sudo[110032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:26 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:26 devstack sudo[110032]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795" returned: 0 in 0.269s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:26 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0 Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facb0078-2ca8-4b11-93a8-f89b8c5be031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934d9357-8cd3-41ba-98ce-cc82f9d33795', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:26 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aeeaf0-4b42-4f24-bd3b-e96016a8a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Volume volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 (934d9357-8cd3-41ba-98ce-cc82f9d33795): created successfully Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aeeaf0-4b42-4f24-bd3b-e96016a8a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e41e900b-58a5-42ac-b533-cba002e332c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-bf996c03-84ad-41ad-b525-f4e409abc30c tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:26 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-faa89db1-3c5c-4b54-8c22-83154c2caec0" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-faa89db1-3c5c-4b54-8c22-83154c2caec0" released by "delete_volume" :: held 0.715s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Created reservations ['a49a8361-5936-43dd-a7c7-dbba7eb74393', '1b2f0c48-55d5-4bc0-9388-10dc386c4619', 'de99f652-5778-47fc-b255-7d3d7b642a30', '2728c9bb-6545-4004-b0c6-dfba18cd7d0f'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:26 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:26 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:26 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.271s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:27 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Deleted volume successfully. Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f9f50f57-a7f9-4370-9daf-be36726a1266 tempest-ProjectReaderTests-398267675 None] Lock "cinder-faa89db1-3c5c-4b54-8c22-83154c2caec0-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Flow 'volume_create_manager' (fe2f4af1-3482-4e97-b59b-ea0b633fe8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4314257-4169-4d16-9bcf-c5ea2524271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4314257-4169-4d16-9bcf-c5ea2524271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8b75c22ec4c75b7702baee959bda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07bb14f2-fdfe-4c11-83e5-bf2fffe5c694,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:27Z,use_quota=True,user_id='47b6ecedfc52434488313a8c34e1bdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21926cba-4039-413c-be75-568b1285d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21926cba-4039-413c-be75-568b1285d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57881c5-2893-4a94-abe5-22ba075f62a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57881c5-2893-4a94-abe5-22ba075f62a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb', 'volume_name': 'volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb', 'volume_size': 1, 'snapshot_id': '07bb14f2-fdfe-4c11-83e5-bf2fffe5c694'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9e652-656e-44a0-b909-1b046a1a138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9e652-656e-44a0-b909-1b046a1a138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55960eae-cf87-4e2e-9295-6f48c083c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Volume bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb', 'volume_size': 1, 'snapshot_id': '07bb14f2-fdfe-4c11-83e5-bf2fffe5c694'} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" by "_create_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Creating volume bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb from snapshot 07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" by "_copy_volume_from_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] snapshot: 07bb14f2-fdfe-4c11-83e5-bf2fffe5c694, volume: bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb, {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a20e1e-de87-4b80-8eb5-61ced6e5d2e2]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:27 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:27 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (67a54490-9011-409a-a4d3-4f08766b71f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05beedc-8772-4ec6-82cf-7bc426401ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05beedc-8772-4ec6-82cf-7bc426401ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167918612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f6865b-0073-4fad-b8ca-786135d895e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:28Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b6912d-f9b6-4b61-84ea-145e6d777547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b6912d-f9b6-4b61-84ea-145e6d777547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923fb10f-ebef-47c5-8582-339d3be6fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923fb10f-ebef-47c5-8582-339d3be6fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f6865b-0073-4fad-b8ca-786135d895e2', 'volume_name': 'volume-94f6865b-0073-4fad-b8ca-786135d895e2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a055d3-4681-42be-8b31-1d404d407e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a055d3-4681-42be-8b31-1d404d407e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cf04dc-a5c1-4bd9-a1be-e02dcc19a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:27 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Volume 94f6865b-0073-4fad-b8ca-786135d895e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f6865b-0073-4fad-b8ca-786135d895e2', 'volume_size': 1} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:27 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a90948-2058-458b-99e8-354a56041521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Creating direct copy from snapshot {{(pid=88715) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[640067b4-ad00-4ecd-99ac-648c1d6faff8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:27 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:27 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:28 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.355s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:28 devstack cinder-volume[88715]: DEBUG cinder.utils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Path /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb not found in is_blk_device check {{(pid=88715) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 16:07:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:28 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb Aug 05 16:07:28 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:32 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" returned: 0 in 4.228s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7432dd-f7f6-48ad-b378-59fc542f7e45]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:32 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:32 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:32 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.503s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG cinder.image.image_utils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Image conversion details: src /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb {{(pid=88715) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 16:07:32 devstack cinder-volume[88715]: INFO cinder.image.image_utils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Converted 1024.00 MB image at 242.10 MB/s Aug 05 16:07:32 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb is being set with open permissions: ugo+rw Aug 05 16:07:32 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:32 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb Aug 05 16:07:32 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:33 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" released by "_copy_volume_from_snapshot" :: held 5.817s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" released by "_create_volume_from_snapshot" :: held 5.847s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.865s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.484s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot 50d183f9-63ef-4574-8ea0-72dbf40ade07 of volume 934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55960eae-cf87-4e2e-9295-6f48c083c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb', 'volume_size': 1, 'snapshot_id': '07bb14f2-fdfe-4c11-83e5-bf2fffe5c694'}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2472432d-caec-4435-92c5-b147d4c33ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[869cb4f1-a035-4ad4-bd13-7b6d0357417c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:33 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Volume volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb (bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb): created successfully Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2472432d-caec-4435-92c5-b147d4c33ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Flow 'volume_create_manager' (fe2f4af1-3482-4e97-b59b-ea0b633fe8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:33 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-078a1dea-26ca-4f79-a3d9-93191c7c86f5 tempest-SnapshotDependencyTests-481849125 None] Created volume successfully. Aug 05 16:07:33 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 Aug 05 16:07:33 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:33 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795" returned: 0 in 0.361s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:33 devstack sudo[110083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 1G Aug 05 16:07:33 devstack sudo[110083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Deleting offline snapshot 07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 of volume 77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] snapshot_file for this snap is: volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6dfa11-143c-44bc-b290-838b802d4135]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:33 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:33 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:33 devstack sudo[110083]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 1G" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:33 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:33 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 Aug 05 16:07:33 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.385s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a90948-2058-458b-99e8-354a56041521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22e94a-01ca-48a2-a647-a9144ebfcdf6]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:34 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07" returned: 0 in 0.322s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 is being set with open permissions: ugo+rw Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 Aug 05 16:07:34 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.362s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:34 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07" returned: 0 in 0.248s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info Aug 05 16:07:34 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info" returned: 0 in 0.263s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info is being set with open permissions: ugo+rw Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:34 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:34 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info Aug 05 16:07:34 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:34 devstack sudo[110119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694 Aug 05 16:07:34 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:35 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.info" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:35 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.383s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167918612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f6865b-0073-4fad-b8ca-786135d895e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500606aee5f74efb9768717de0ea4e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:28Z,use_quota=True,user_id='cc2e4c89b846414fac0e435207ef2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Creating volume 94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:35 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521.07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" returned: 0 in 0.285s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:35 devstack sudo[110123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 1073741824 Aug 05 16:07:35 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-5b8a9499-3582-4f2e-b5a0-4aeb3946999b tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694" released by "_delete_snapshot" :: held 1.489s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" released by "delete_snapshot" :: held 1.516s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Created reservations ['595f5d52-3ca3-4496-acf6-88a4d61b96cc', 'c15ca4f0-c005-4671-a99c-1555e26e955d', '5228ae9d-a4b2-4a62-8973-53facbb28bfa', '9456065c-b165-4f6a-a576-4ce29ef38b97'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Delete snapshot completed successfully. Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9b24ae4c-2322-4b26-a9ff-2c63bd4b675b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-07bb14f2-fdfe-4c11-83e5-bf2fffe5c694-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:35 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 1073741824" returned: 0 in 0.429s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:35 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 Aug 05 16:07:35 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-77a90948-2058-458b-99e8-354a56041521-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:35 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-77a90948-2058-458b-99e8-354a56041521-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cf04dc-a5c1-4bd9-a1be-e02dcc19a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f6865b-0073-4fad-b8ca-786135d895e2', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6758ba-3b4c-4c3d-95cc-bbbd71fb283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:35 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Volume volume-94f6865b-0073-4fad-b8ca-786135d895e2 (94f6865b-0073-4fad-b8ca-786135d895e2): created successfully Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6758ba-3b4c-4c3d-95cc-bbbd71fb283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Flow 'volume_create_manager' (67a54490-9011-409a-a4d3-4f08766b71f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:35 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2ba6451f-834d-4825-9c42-77615082c3ad tempest-ProjectReaderTests-398267675 None] Created volume successfully. Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-50d183f9-63ef-4574-8ea0-72dbf40ade07-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a70fbc-8c65-4f4d-95a2-33d6b255d44e]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-50d183f9-63ef-4574-8ea0-72dbf40ade07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-50d183f9-63ef-4574-8ea0-72dbf40ade07" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:35 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-50d183f9-63ef-4574-8ea0-72dbf40ade07" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot 50d183f9-63ef-4574-8ea0-72dbf40ade07 of volume 934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239ff19-d561-4552-86a8-b694db0816b7]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:36 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 Aug 05 16:07:36 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.427s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521 Aug 05 16:07:36 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Creating offline snapshot 23dd8820-0f30-493c-b66f-dbc379dea118 of volume 94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bf30a4-33e2-4982-8e07-e66b6df5e3c4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07" returned: 0 in 0.466s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934d9357-8cd3-41ba-98ce-cc82f9d33795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed46d14-0978-4295-b7f4-faf1556f2faf]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 Aug 05 16:07:36 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 Aug 05 16:07:36 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-77a90948-2058-458b-99e8-354a56041521" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-77a90948-2058-458b-99e8-354a56041521" released by "delete_volume" :: held 0.799s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Created reservations ['4e1c4360-305c-4110-aa35-5356548d79f1', '9600ddce-3e89-4a56-89c9-dde0075855b2', 'fb008b6b-b3b6-4d90-9958-59cc9d160ef5', '60b83696-42e4-4239-ba03-89bf57430b0b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:36 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2" returned: 0 in 0.396s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:36 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 1G Aug 05 16:07:36 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:36 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:37 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795" returned: 0 in 0.476s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:37 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 Aug 05 16:07:37 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:37 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.321s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" acquired by "delete_volume" :: waited 0.035s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Deleted volume successfully. Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c5239c-ec83-4cce-9dca-d071c1eeb017]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-53fe15b8-85f5-4d71-beae-444f8e99593b tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-77a90948-2058-458b-99e8-354a56041521-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:37 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb Aug 05 16:07:37 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 1G" returned: 0 in 0.485s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6865b-0073-4fad-b8ca-786135d895e2 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack sudo[110169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6865b-0073-4fad-b8ca-786135d895e2 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 Aug 05 16:07:37 devstack sudo[110169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07" returned: 0 in 0.396s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07 Aug 05 16:07:37 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" returned: 0 in 0.414s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb Aug 05 16:07:37 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack sudo[110169]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6865b-0073-4fad-b8ca-786135d895e2 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118" returned: 0 in 0.294s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 is being set with open permissions: ugo+rw Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 Aug 05 16:07:37 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795.50d183f9-63ef-4574-8ea0-72dbf40ade07" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-50d183f9-63ef-4574-8ea0-72dbf40ade07" released by "_delete_snapshot" :: held 1.744s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" released by "delete_snapshot" :: held 1.767s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Created reservations ['7342236d-1ec4-4c73-8885-89daadc9f1aa', 'ababa75d-e19b-465f-942f-26cd779cecd4', '89a3252c-999e-4dec-ae93-105e25716728', '096fbe76-cec2-42ae-b7a3-219769a72008'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:37 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c0cc7da1-eb64-47c0-8b16-0476aa6587eb tempest-ProjectMemberTests-1210085068 None] Lock "cinder-50d183f9-63ef-4574-8ea0-72dbf40ade07-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:37 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" returned: 0 in 0.290s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-quobyte-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb" released by "delete_volume" :: held 0.751s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:37 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:37 devstack sudo[110186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info Aug 05 16:07:37 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:37 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Created reservations ['f6691bd7-9cad-4b91-aa95-b104efbcd8b4', '81095af4-536b-4973-89e5-c09dc2031136', '7531998f-8706-4630-bf56-e11119bdbead', '5bae108c-8e44-44f2-8ae2-3a2f197bae27'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-934d9357-8cd3-41ba-98ce-cc82f9d33795-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:38 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:38 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-934d9357-8cd3-41ba-98ce-cc82f9d33795-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" acquired by "delete_volume" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[044e78eb-3f4e-4001-96a8-4133f46f65a4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:38 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info" returned: 0 in 0.338s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:38 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info is being set with open permissions: ugo+rw Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:38 devstack sudo[110192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info Aug 05 16:07:38 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:38 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.310s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Deleted volume successfully. Aug 05 16:07:38 devstack sudo[110191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 Aug 05 16:07:38 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d4b85dce-2278-472b-910e-4e25c257114e tempest-SnapshotDependencyTests-481849125 None] Lock "cinder-bd5ab4b1-33c2-4dd2-bd18-e9ef9d949ecb-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:38 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.info" returned: 0 in 0.280s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:38 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a7f5c14c-b7e3-4450-9f23-cc5e8d7176df tempest-ProjectReaderTests-398267675 None] Create snapshot completed successfully Aug 05 16:07:38 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795" returned: 0 in 0.423s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:38 devstack sudo[110201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795 Aug 05 16:07:38 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:38 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-934d9357-8cd3-41ba-98ce-cc82f9d33795" returned: 0 in 0.248s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:38 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-934d9357-8cd3-41ba-98ce-cc82f9d33795" released by "delete_volume" :: held 0.754s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Created reservations ['d2eca44c-663a-4b72-9225-475fb6cdeaa2', 'a75970d2-5be6-42e1-a703-3802856b4a71', '6d13e6cc-04d6-4f56-9721-65ebd55f56c8', '9e4acc83-8d2d-4713-b521-c51cab559683'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:39 devstack sudo[110204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:39 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:39 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:39 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a6f10a97-b68b-4262-b7fd-b90925bbee58 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-934d9357-8cd3-41ba-98ce-cc82f9d33795-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-23dd8820-0f30-493c-b66f-dbc379dea118-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-23dd8820-0f30-493c-b66f-dbc379dea118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-23dd8820-0f30-493c-b66f-dbc379dea118" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-23dd8820-0f30-493c-b66f-dbc379dea118" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Deleting offline snapshot 23dd8820-0f30-493c-b66f-dbc379dea118 of volume 94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] snapshot_file for this snap is: volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80a298-ab36-4c57-bf4b-4ef78731b55f]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (ee2caadd-8cbf-4e0a-9360-5e1bcadfd862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa376cca-17cd-4ea5-8636-890dda2d6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa376cca-17cd-4ea5-8636-890dda2d6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114920381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53153ef-58d2-4583-b5f7-931a4f5a72cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:40Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf80835-e0ad-4acd-a977-7885ce210bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf80835-e0ad-4acd-a977-7885ce210bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a58c14-278d-4a33-9be7-9e539c81c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a58c14-278d-4a33-9be7-9e539c81c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53153ef-58d2-4583-b5f7-931a4f5a72cc', 'volume_name': 'volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e117eee-95f6-4d43-a0c6-4c8ce3e15907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e117eee-95f6-4d43-a0c6-4c8ce3e15907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:39 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 Aug 05 16:07:39 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd160dc-6fb8-41d3-8dd4-7750f29363cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:39 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Volume c53153ef-58d2-4583-b5f7-931a4f5a72cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc', 'volume_size': 1} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114920381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53153ef-58d2-4583-b5f7-931a4f5a72cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:40Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Creating volume c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:39 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:39 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:39 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc 1073741824 Aug 05 16:07:39 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:40 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118" returned: 0 in 0.420s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f6865b-0073-4fad-b8ca-786135d895e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc2d5ce-74f9-4b5c-87d4-d1005b8abf6b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:40 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 Aug 05 16:07:40 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:40 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc 1073741824" returned: 0 in 0.479s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:40 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc Aug 05 16:07:40 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:40 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2" returned: 0 in 0.410s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:40 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 Aug 05 16:07:40 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:40 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc" returned: 0 in 0.260s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd160dc-6fb8-41d3-8dd4-7750f29363cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e6a4b-9bb1-4df7-9c58-30dfaa4ceb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:40 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Volume volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc (c53153ef-58d2-4583-b5f7-931a4f5a72cc): created successfully Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e6a4b-9bb1-4df7-9c58-30dfaa4ceb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:40 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (ee2caadd-8cbf-4e0a-9360-5e1bcadfd862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:40 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1a1331c6-1cd0-4751-baaa-5dd664db60bf tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:41 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118" returned: 0 in 0.395s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:41 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118 Aug 05 16:07:41 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:41 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2.23dd8820-0f30-493c-b66f-dbc379dea118" returned: 0 in 0.257s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-23dd8820-0f30-493c-b66f-dbc379dea118" released by "_delete_snapshot" :: held 1.585s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" released by "delete_snapshot" :: held 1.618s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Created reservations ['bc66e76e-1754-4fbd-a2d8-16c5711d8a5b', '5c286063-21e3-4a86-884c-d29ee4e1c130', '007f44e5-e523-4035-8ee9-9e9a77b97e3e', 'ff2005e7-2929-490e-9df7-e0cabe730921'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:41 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Delete snapshot completed successfully. Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ad2595b6-d01b-4ce9-8550-d1604d376132 tempest-ProjectReaderTests-398267675 None] Lock "cinder-23dd8820-0f30-493c-b66f-dbc379dea118-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-94f6865b-0073-4fad-b8ca-786135d895e2-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "cinder-94f6865b-0073-4fad-b8ca-786135d895e2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Acquiring lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:41 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e923f52-6587-46d6-acc9-a7624907870c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:42 devstack sudo[110269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 Aug 05 16:07:42 devstack sudo[110269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 of volume c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b104c928-976c-4991-80d0-c33e369905bc]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:42 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc Aug 05 16:07:42 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:42 devstack sudo[110269]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2" returned: 0 in 0.479s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:42 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2 Aug 05 16:07:42 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:42 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:42 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 1G Aug 05 16:07:42 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:42 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-94f6865b-0073-4fad-b8ca-786135d895e2" returned: 0 in 0.296s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "cinder-quobyte-94f6865b-0073-4fad-b8ca-786135d895e2" released by "delete_volume" :: held 0.881s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:42 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Created reservations ['6c2a3e22-9764-442b-87dd-0d1505449518', 'c12df6e1-5a53-4f66-a2c1-26091dfae7ce', '449d3317-eddb-4bcf-bd0d-dd81b2caabbb', '01ef5ed9-a788-46fb-a37c-07aed98698d6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:43 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:43 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:43 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 1G" returned: 0 in 0.569s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:43 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 Aug 05 16:07:43 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:43 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.318s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:43 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Deleted volume successfully. Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-225affbe-7de8-4594-b8eb-b09cb97bc29d tempest-ProjectReaderTests-398267675 None] Lock "cinder-94f6865b-0073-4fad-b8ca-786135d895e2-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:43 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:43 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 is being set with open permissions: ugo+rw Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:43 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 Aug 05 16:07:43 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:43 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" returned: 0 in 0.280s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:43 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:43 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info Aug 05 16:07:43 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:44 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info" returned: 0 in 0.278s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:44 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info is being set with open permissions: ugo+rw Aug 05 16:07:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:44 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info Aug 05 16:07:44 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:44 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.info" returned: 0 in 0.275s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:44 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:44 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-247c0b99-95f4-4942-9f4d-2d2ac7552cff tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 of volume c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198c568-6daa-44c8-827d-a8684bd80fce]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:45 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:45 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 Aug 05 16:07:45 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:46 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" returned: 0 in 0.397s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb6132-95d6-4db3-8b5f-c1ee198c6fe8]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:46 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc Aug 05 16:07:46 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:46 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc" returned: 0 in 0.383s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:46 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 Aug 05 16:07:46 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:46 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" returned: 0 in 0.535s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:46 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:46 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871 Aug 05 16:07:46 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:47 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc.ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" returned: 0 in 0.282s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871" released by "_delete_snapshot" :: held 1.735s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" released by "delete_snapshot" :: held 1.764s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Created reservations ['d8f56177-2833-4b34-bd9a-ce45b39227c7', '825f7089-6aa0-42df-8db3-26f52927a283', 'e4a4cd33-2acf-4251-b888-24407d7a4d91', 'c2c4cefc-2dac-4ffa-b6a8-b06efca3e973'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:47 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f98875c9-fcee-4487-9e3b-4f57823f4db1 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-ccf2fdcd-bc6b-46a9-8cae-e8546eda8871-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-c53153ef-58d2-4583-b5f7-931a4f5a72cc-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "cinder-c53153ef-58d2-4583-b5f7-931a4f5a72cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1a02e-f23a-4fe5-8ccb-f86eedcbfcfe]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:47 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:47 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc Aug 05 16:07:47 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:48 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (8e92b6e5-9e75-4e58-b626-06cdd7549f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a6948e-eda5-4a5e-b919-c0bc33eefaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc" returned: 0 in 0.474s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a6948e-eda5-4a5e-b919-c0bc33eefaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549286933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299624be-29f8-428e-994f-b6b650cf0556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:48Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:48 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc Aug 05 16:07:48 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d46280f-6dca-4e49-ab44-5d4cce2661b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d46280f-6dca-4e49-ab44-5d4cce2661b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455b1c8a-cd50-4fb5-a09e-2356e7309215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455b1c8a-cd50-4fb5-a09e-2356e7309215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299624be-29f8-428e-994f-b6b650cf0556', 'volume_name': 'volume-299624be-29f8-428e-994f-b6b650cf0556', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaf0b89-9deb-40af-9516-c3991ed74ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaf0b89-9deb-40af-9516-c3991ed74ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0312bb-7b35-492a-a0e6-2e23e1fdfa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:48 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Volume 299624be-29f8-428e-994f-b6b650cf0556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299624be-29f8-428e-994f-b6b650cf0556', 'volume_size': 1} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549286933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299624be-29f8-428e-994f-b6b650cf0556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:48Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Creating volume 299624be-29f8-428e-994f-b6b650cf0556 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:48 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:48 devstack sudo[110341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 1073741824 Aug 05 16:07:48 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:48 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-c53153ef-58d2-4583-b5f7-931a4f5a72cc" returned: 0 in 0.272s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-c53153ef-58d2-4583-b5f7-931a4f5a72cc" released by "delete_volume" :: held 0.827s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Created reservations ['4827ce8c-9d77-445a-b047-e6960ba86d05', 'e099e46d-028f-476d-8fd0-2bd9e6903676', 'ed4315c8-6288-4a97-b23d-208b7ea6fba6', 'fe756df1-d136-4e60-94c0-1bd2402fcddd'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:48 devstack sudo[110348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:48 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:48 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 1073741824" returned: 0 in 0.532s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:48 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:48 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 Aug 05 16:07:48 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:49 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.306s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-12da3060-e702-45b3-8d6c-6975b0d2969d tempest-ProjectMemberTests-1210085068 None] Lock "cinder-c53153ef-58d2-4583-b5f7-931a4f5a72cc-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:49 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556" returned: 0 in 0.359s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0312bb-7b35-492a-a0e6-2e23e1fdfa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299624be-29f8-428e-994f-b6b650cf0556', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f5bc4-9586-45f5-bbe7-c07dff88dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Volume volume-299624be-29f8-428e-994f-b6b650cf0556 (299624be-29f8-428e-994f-b6b650cf0556): created successfully Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f5bc4-9586-45f5-bbe7-c07dff88dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (8e92b6e5-9e75-4e58-b626-06cdd7549f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:49 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-21cce0f1-b665-4870-ae38-96ed2f96632d tempest-ProjectReaderTests-120642961 None] Created volume successfully. Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (b4e788d2-607a-4b3c-8bc2-32f826fc866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c629b7-5674-4ae3-82a6-c36f140af20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c629b7-5674-4ae3-82a6-c36f140af20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875145640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294dee01-41ac-4775-b07d-c5157f100a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:49Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2eb6d-73ef-4c96-86bf-8d7f294c8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2eb6d-73ef-4c96-86bf-8d7f294c8e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1254278b-e796-4fde-a0de-185560e68849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1254278b-e796-4fde-a0de-185560e68849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294dee01-41ac-4775-b07d-c5157f100a4c', 'volume_name': 'volume-294dee01-41ac-4775-b07d-c5157f100a4c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d7b49-4297-40c1-ad20-3f0fa9c8620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d7b49-4297-40c1-ad20-3f0fa9c8620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa425eaf-db0b-4878-aa11-bc31eb539c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:49 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Volume 294dee01-41ac-4775-b07d-c5157f100a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294dee01-41ac-4775-b07d-c5157f100a4c', 'volume_size': 1} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875145640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294dee01-41ac-4775-b07d-c5157f100a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:49Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Creating volume 294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:49 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:49 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c 1073741824 Aug 05 16:07:49 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:49 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:49 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c 1073741824" returned: 0 in 0.432s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:50 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c Aug 05 16:07:50 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:50 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c" returned: 0 in 0.259s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa425eaf-db0b-4878-aa11-bc31eb539c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294dee01-41ac-4775-b07d-c5157f100a4c', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65695dc9-f073-431d-a38d-468974cbf944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:50 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Volume volume-294dee01-41ac-4775-b07d-c5157f100a4c (294dee01-41ac-4775-b07d-c5157f100a4c): created successfully Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65695dc9-f073-431d-a38d-468974cbf944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (b4e788d2-607a-4b3c-8bc2-32f826fc866e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:50 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-3ff5d2d2-a8fe-412e-9764-72b1a991b9c8 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot 8543922b-f988-4b6d-a6a8-e6a2f9867feb of volume 294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-299624be-29f8-428e-994f-b6b650cf0556-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640aa8e-cdc1-4794-99a0-ca10a9b97f2b]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "cinder-299624be-29f8-428e-994f-b6b650cf0556-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-quobyte-299624be-29f8-428e-994f-b6b650cf0556" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-299624be-29f8-428e-994f-b6b650cf0556" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05fbfa2-50cc-44af-bd58-f7eb99d51157]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:50 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:50 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c Aug 05 16:07:50 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:50 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 Aug 05 16:07:50 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c" returned: 0 in 0.374s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:51 devstack sudo[110369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb 1G Aug 05 16:07:51 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556" returned: 0 in 0.371s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:51 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556 Aug 05 16:07:51 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-299624be-29f8-428e-994f-b6b650cf0556" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-299624be-29f8-428e-994f-b6b650cf0556" released by "delete_volume" :: held 0.676s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:51 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb 1G" returned: 0 in 0.414s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294dee01-41ac-4775-b07d-c5157f100a4c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Created reservations ['5f886819-dff4-49cd-80d8-2d8b2c5c5156', '7791ec5f-4144-462a-8de9-a1282af89ef8', 'de1da50d-b498-4e03-9634-67c87c8ce86d', 'e0d758c6-bc9a-45d3-bafe-654f302ec250'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:51 devstack sudo[110381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294dee01-41ac-4775-b07d-c5157f100a4c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb Aug 05 16:07:51 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:51 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:51 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294dee01-41ac-4775-b07d-c5157f100a4c -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb" returned: 0 in 0.297s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb is being set with open permissions: ugo+rw Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:51 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb Aug 05 16:07:51 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:51 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.267s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:51 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Deleted volume successfully. Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-9ff85f9a-9f61-4b08-bcd0-c1f4bda20bb6 tempest-ProjectReaderTests-120642961 None] Lock "cinder-299624be-29f8-428e-994f-b6b650cf0556-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:51 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:51 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb" returned: 0 in 0.260s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:52 devstack sudo[110392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info Aug 05 16:07:52 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (6dfff674-1727-4622-9cdc-66759efdb84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2370c22-5ca0-4f04-879f-ce3caef31141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:52 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2370c22-5ca0-4f04-879f-ce3caef31141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476868786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:52Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb09faf3-1444-49f2-b165-b291e5f85039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb09faf3-1444-49f2-b165-b291e5f85039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a022a-1f04-44e2-94da-7fb3cc0ced10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a022a-1f04-44e2-94da-7fb3cc0ced10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd', 'volume_name': 'volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a752453-f677-4799-92e0-7120eaaa64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a752453-f677-4799-92e0-7120eaaa64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5186ed-b00b-44d0-8498-07039e80a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:52 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Volume 9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd', 'volume_size': 1} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info" returned: 0 in 0.316s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:52 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info is being set with open permissions: ugo+rw Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:52 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info Aug 05 16:07:52 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:52 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.info" returned: 0 in 0.235s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476868786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:52Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Creating volume 9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:52 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:52 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:52 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd 1073741824 Aug 05 16:07:52 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:52 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-47cc60cb-7684-4b8e-bc03-1e26816db6a6 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:07:53 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd 1073741824" returned: 0 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:53 devstack sudo[110404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd Aug 05 16:07:53 devstack sudo[110404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:53 devstack sudo[110404]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5186ed-b00b-44d0-8498-07039e80a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1522e200-2d8f-4f97-88da-9150fae44a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:53 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Volume volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd (9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd): created successfully Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1522e200-2d8f-4f97-88da-9150fae44a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (6dfff674-1727-4622-9cdc-66759efdb84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:53 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6d8b8240-50b9-45a0-b914-55d912fe7148 tempest-ProjectReaderTests-120642961 None] Created volume successfully. Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-8543922b-f988-4b6d-a6a8-e6a2f9867feb-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-8543922b-f988-4b6d-a6a8-e6a2f9867feb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-8543922b-f988-4b6d-a6a8-e6a2f9867feb" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-8543922b-f988-4b6d-a6a8-e6a2f9867feb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot 8543922b-f988-4b6d-a6a8-e6a2f9867feb of volume 294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b575f065-e87f-469a-ba80-99fbe93361ab]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:53 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:53 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb Aug 05 16:07:53 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:54 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb" returned: 0 in 0.360s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294dee01-41ac-4775-b07d-c5157f100a4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427c861-a025-41b6-b105-f57592ab4657]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:54 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c Aug 05 16:07:54 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "cinder-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-quobyte-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9df77-7e69-4cf5-ac12-641589413ead]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:54 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c" returned: 0 in 0.365s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:54 devstack sudo[110415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd Aug 05 16:07:54 devstack sudo[110415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:54 devstack sudo[110420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb Aug 05 16:07:54 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:54 devstack sudo[110415]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" returned: 0 in 0.378s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:54 devstack sudo[110428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd Aug 05 16:07:54 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:54 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb" returned: 0 in 0.351s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:54 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:54 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb Aug 05 16:07:54 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:55 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" returned: 0 in 0.245s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd" released by "delete_volume" :: held 0.667s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:UPDATE=222,cinder:INSERT=56,cinder:SELECT=169,cinder:DELETE=20 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=186,cinder:UPDATE=223,cinder:DELETE=18,cinder:INSERT=64 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Created reservations ['4c197fae-1ae0-46cf-94ea-832f7240ed4b', 'ee0c7d28-4812-4405-9f2e-e5d73c917514', '078e3a8f-3d82-41b4-bc72-603bad00d677', '18e53ba3-658e-4baf-a504-81859699887e'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:55 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c.8543922b-f988-4b6d-a6a8-e6a2f9867feb" returned: 0 in 0.270s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-8543922b-f988-4b6d-a6a8-e6a2f9867feb" released by "_delete_snapshot" :: held 1.432s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" released by "delete_snapshot" :: held 1.454s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:55 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:55 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Created reservations ['ab23c097-23d0-4d1f-b9e7-313a21568264', '71dc04c9-f7b3-4181-b76c-931905d5b90b', '85bbd362-9c6e-474c-8063-fd40bd69b552', '04a2f566-0d84-47ce-99e0-48d6efb21a2a'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ea3b6c22-44a2-45ef-87c5-5ef421cbf2f6 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-8543922b-f988-4b6d-a6a8-e6a2f9867feb-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:55 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.252s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:55 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Deleted volume successfully. Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-2ba65843-6faf-478c-91fb-fa6a7d5e4a59 tempest-ProjectReaderTests-120642961 None] Lock "cinder-9895a8ef-a4bb-45d9-85eb-fd244aa3e6dd-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-294dee01-41ac-4775-b07d-c5157f100a4c-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "cinder-294dee01-41ac-4775-b07d-c5157f100a4c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:55 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (97d40be0-68d7-4637-8519-c31451161ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe30a4b6-6127-434b-b2d0-30c23322ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe30a4b6-6127-434b-b2d0-30c23322ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001564981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dee9118-a0eb-460e-beea-1da1ec82ed4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:56Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d33d6b-6f3d-4837-b8a2-62363b2a2abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d33d6b-6f3d-4837-b8a2-62363b2a2abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01dd92a-810e-4825-b80f-9269322de6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01dd92a-810e-4825-b80f-9269322de6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dee9118-a0eb-460e-beea-1da1ec82ed4d', 'volume_name': 'volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2fb2a8-12dd-41dd-a479-047e94cc6a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2fb2a8-12dd-41dd-a479-047e94cc6a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f7266-6f8f-46b6-915a-b8e6fc45a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Volume 8dee9118-a0eb-460e-beea-1da1ec82ed4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d', 'volume_size': 1} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001564981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dee9118-a0eb-460e-beea-1da1ec82ed4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:56Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Creating volume 8dee9118-a0eb-460e-beea-1da1ec82ed4d {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:56 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:56 devstack sudo[110437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d 1073741824 Aug 05 16:07:56 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16912fb-5feb-4d4e-a074-8873e0b2b064]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:56 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c Aug 05 16:07:56 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:56 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d 1073741824" returned: 0 in 0.429s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:56 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c" returned: 0 in 0.386s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:56 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d Aug 05 16:07:56 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:56 devstack sudo[110448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c Aug 05 16:07:56 devstack sudo[110448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:56 devstack sudo[110448]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-294dee01-41ac-4775-b07d-c5157f100a4c" returned: 0 in 0.247s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:56 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d" returned: 0 in 0.274s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-294dee01-41ac-4775-b07d-c5157f100a4c" released by "delete_volume" :: held 0.715s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759f7266-6f8f-46b6-915a-b8e6fc45a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352744f8-a10c-4d32-a234-de55f2320d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:56 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Volume volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d (8dee9118-a0eb-460e-beea-1da1ec82ed4d): created successfully Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352744f8-a10c-4d32-a234-de55f2320d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (97d40be0-68d7-4637-8519-c31451161ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:56 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-2f7c2faa-deff-4e46-bcd7-a76b39f36b4a tempest-ProjectReaderTests-120642961 None] Created volume successfully. Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Created reservations ['5f9bdda4-72dc-4cfa-bdd8-28af4a06a5ee', 'f2edf1b7-5721-487e-b39a-3de9438e6c81', 'cbeb926c-ce6b-4412-9e19-a9be29cca7e3', '7dae4059-8d17-441c-9f1d-ffca307488af'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:56 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:57 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:57 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-8dee9118-a0eb-460e-beea-1da1ec82ed4d-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "cinder-8dee9118-a0eb-460e-beea-1da1ec82ed4d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-quobyte-8dee9118-a0eb-460e-beea-1da1ec82ed4d" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-8dee9118-a0eb-460e-beea-1da1ec82ed4d" acquired by "delete_volume" :: waited 0.024s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[affbd5b3-fb77-44c4-8df9-f2cfd4aaa25d]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:57 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.299s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:57 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-ab2af0a5-f731-4733-96fc-669c97e20b8e tempest-ProjectMemberTests-1210085068 None] Lock "cinder-294dee01-41ac-4775-b07d-c5157f100a4c-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:57 devstack sudo[110455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d Aug 05 16:07:57 devstack sudo[110455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:57 devstack sudo[110455]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e615d24c-c617-498f-a79a-1f4422a771b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade7a186-57c6-40ab-b400-226e3360f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d" returned: 0 in 0.414s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:57 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade7a186-57c6-40ab-b400-226e3360f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947695846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e2a72-a988-49e3-8985-4e0cbb6579d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:58Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:57 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c8cd86-9e2c-441b-b4e7-ef94c9bda1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c8cd86-9e2c-441b-b4e7-ef94c9bda1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9293409c-3be1-4280-a46e-6c474d68abd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9293409c-3be1-4280-a46e-6c474d68abd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6e2a72-a988-49e3-8985-4e0cbb6579d6', 'volume_name': 'volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a23fa-0b9a-4049-a8ba-9366c8c9447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a23fa-0b9a-4049-a8ba-9366c8c9447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58554e56-0cef-46c1-80e7-85e7437e318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:57 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Volume 0f6e2a72-a988-49e3-8985-4e0cbb6579d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6', 'volume_size': 1} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947695846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6e2a72-a988-49e3-8985-4e0cbb6579d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:58Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Creating volume 0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:57 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:57 devstack sudo[110463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 1073741824 Aug 05 16:07:57 devstack sudo[110463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:57 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dee9118-a0eb-460e-beea-1da1ec82ed4d" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-8dee9118-a0eb-460e-beea-1da1ec82ed4d" released by "delete_volume" :: held 0.720s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Created reservations ['ee6bf94f-88e5-4b36-bbdf-96fff8595f40', 'efc87a67-9b90-4820-86af-5aa79167176c', '4dfda4a9-1b11-4d11-9af8-a46e523cacd8', 'e9bf9c12-0103-45f8-8592-ce14c63e70ce'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:57 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:58 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:07:58 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:58 devstack sudo[110463]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 1073741824" returned: 0 in 0.433s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:58 devstack sudo[110472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 Aug 05 16:07:58 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:58 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:07:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Deleted volume successfully. Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-1a4cc689-87a5-4065-9159-b2b9fabf6bcf tempest-ProjectReaderTests-120642961 None] Lock "cinder-8dee9118-a0eb-460e-beea-1da1ec82ed4d-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:07:58 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" returned: 0 in 0.266s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58554e56-0cef-46c1-80e7-85e7437e318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a962cc-19f2-4d22-9814-d3c9db0846a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Volume volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 (0f6e2a72-a988-49e3-8985-4e0cbb6579d6): created successfully Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a962cc-19f2-4d22-9814-d3c9db0846a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (e615d24c-c617-498f-a79a-1f4422a771b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:58 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-97caed0f-7ab4-4017-ba56-85bcbb5b7e64 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (2c78631b-5446-48e1-a05d-8af7a428372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6527c-7e9a-4a09-8b2d-3698c26d2dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6527c-7e9a-4a09-8b2d-3698c26d2dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876390906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e1e97e-965b-4df0-84d4-a7d9709524ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:59Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07bc10-0ca7-4927-a34e-9ee7e8bfa195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07bc10-0ca7-4927-a34e-9ee7e8bfa195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b2852d-b41b-49fa-9e1a-08e1e2ec1268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b2852d-b41b-49fa-9e1a-08e1e2ec1268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e1e97e-965b-4df0-84d4-a7d9709524ac', 'volume_name': 'volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cd7a8a-9063-4bc1-996a-d27621c4b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cd7a8a-9063-4bc1-996a-d27621c4b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867d5b2-0360-4de2-b8f8-90fb8a2f9baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:58 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Volume b7e1e97e-965b-4df0-84d4-a7d9709524ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac', 'volume_size': 1} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876390906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e1e97e-965b-4df0-84d4-a7d9709524ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82f491ee63f4102b32041e8a0a68e88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:07:59Z,use_quota=True,user_id='ab5ce5a9ade64e31880fcca9b2cbfb6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Creating volume b7e1e97e-965b-4df0-84d4-a7d9709524ac {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:07:58 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:58 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac 1073741824 Aug 05 16:07:58 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:07:58 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:59 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac 1073741824" returned: 0 in 0.405s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:59 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac Aug 05 16:07:59 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:59 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac" returned: 0 in 0.251s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot 74007a06-bd98-4dc0-8cc1-bcfd5723c78b of volume 0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867d5b2-0360-4de2-b8f8-90fb8a2f9baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92d0cfc-43be-4709-bcf9-568f5dbb8ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[0559e020-d3ad-4387-b349-482052da8d99]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:59 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Volume volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac (b7e1e97e-965b-4df0-84d4-a7d9709524ac): created successfully Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92d0cfc-43be-4709-bcf9-568f5dbb8ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Flow 'volume_create_manager' (2c78631b-5446-48e1-a05d-8af7a428372b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:07:59 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-76903b66-aa72-4c08-89d7-74e6da4220fd tempest-ProjectReaderTests-120642961 None] Created volume successfully. Aug 05 16:07:59 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 Aug 05 16:07:59 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:07:59 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:07:59 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:07:59 devstack sudo[110490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b 1G Aug 05 16:07:59 devstack sudo[110490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:00 devstack sudo[110490]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b 1G" returned: 0 in 0.377s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:00 devstack sudo[110496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b Aug 05 16:08:00 devstack sudo[110496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:00 devstack sudo[110496]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b" returned: 0 in 0.280s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:00 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b is being set with open permissions: ugo+rw Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:00 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b Aug 05 16:08:00 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-b7e1e97e-965b-4df0-84d4-a7d9709524ac-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:00 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b" returned: 0 in 0.268s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "cinder-b7e1e97e-965b-4df0-84d4-a7d9709524ac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:00 devstack sudo[110505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Acquiring lock "cinder-quobyte-b7e1e97e-965b-4df0-84d4-a7d9709524ac" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:00 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-b7e1e97e-965b-4df0-84d4-a7d9709524ac" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb96e72-2abb-4341-a528-5c67e130cd1c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:00 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:01 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac Aug 05 16:08:01 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:01 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info" returned: 0 in 0.276s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:01 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info is being set with open permissions: ugo+rw Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:01 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info Aug 05 16:08:01 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:01 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac" returned: 0 in 0.367s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:01 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac Aug 05 16:08:01 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:01 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.info" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-e4b3d9a6-2a79-4f43-bdaa-b0ebf6dfc719 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:08:01 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-b7e1e97e-965b-4df0-84d4-a7d9709524ac" returned: 0 in 0.256s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "cinder-quobyte-b7e1e97e-965b-4df0-84d4-a7d9709524ac" released by "delete_volume" :: held 0.670s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Created reservations ['3f54de1c-0daf-4792-af3e-861e9427e913', '1a6ddc5d-86ad-487f-b23e-c3b953033cd2', '1b5480fe-ef04-4d9f-923d-1fffc0c5febb', '838d5665-57aa-4edb-a25e-49ab31cda5eb'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:01 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:01 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-74007a06-bd98-4dc0-8cc1-bcfd5723c78b-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:01 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.261s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-74007a06-bd98-4dc0-8cc1-bcfd5723c78b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:01 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:01 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Deleted volume successfully. Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-74007a06-bd98-4dc0-8cc1-bcfd5723c78b" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-af7d03f2-7d56-4473-945c-3f1ee90761f9 tempest-ProjectReaderTests-120642961 None] Lock "cinder-b7e1e97e-965b-4df0-84d4-a7d9709524ac-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-74007a06-bd98-4dc0-8cc1-bcfd5723c78b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot 74007a06-bd98-4dc0-8cc1-bcfd5723c78b of volume 0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656ecac-1d17-4816-a0af-96b89b85cf59]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:02 devstack sudo[110522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b Aug 05 16:08:02 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:02 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b" returned: 0 in 0.375s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a3a32-71ca-4493-9805-628441b66382]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:02 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 Aug 05 16:08:02 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:02 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" returned: 0 in 0.381s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:02 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:02 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b Aug 05 16:08:02 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:03 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b" returned: 0 in 0.379s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:03 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b Aug 05 16:08:03 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:03 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6.74007a06-bd98-4dc0-8cc1-bcfd5723c78b" returned: 0 in 0.277s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-74007a06-bd98-4dc0-8cc1-bcfd5723c78b" released by "_delete_snapshot" :: held 1.517s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" released by "delete_snapshot" :: held 1.546s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Created reservations ['4cc29c64-4913-4d13-9d28-f66f5ecd9494', '671cd0a9-f645-429c-9718-614ac3ec1325', 'e0b39e47-f15b-4843-a645-b7893a20a122', 'abddb7ef-de0c-499f-989e-3b22646b63e6'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:03 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-fc4a1367-e355-4493-994b-f2a3ddbe29ea tempest-ProjectMemberTests-1210085068 None] Lock "cinder-74007a06-bd98-4dc0-8cc1-bcfd5723c78b-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:03 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:03 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:03 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.246s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager._thread_info {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread count: 28 {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 16:08:03 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] thread info: [<_MainThread(MainThread, started 140563867963520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88715) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-0f6e2a72-a988-49e3-8985-4e0cbb6579d6-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-0f6e2a72-a988-49e3-8985-4e0cbb6579d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" acquired by "delete_volume" :: waited 0.015s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022ccd2-936c-45b1-8698-ef7246f4b7be]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:04 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 Aug 05 16:08:04 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:04 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:04 devstack sudo[110549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6 Aug 05 16:08:04 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:04 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" returned: 0 in 0.241s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-0f6e2a72-a988-49e3-8985-4e0cbb6579d6" released by "delete_volume" :: held 0.652s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Created reservations ['55b9b243-b25f-486f-a1dd-e8289837b067', '0a8bd36d-9148-446e-9efd-727081b1ea1b', '193700ba-b669-4987-8712-d9f898d2a805', '14ea3481-b633-44ab-ad06-24b719b45e34'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:04 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:04 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:04 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:05 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.257s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:05 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f0556029-e999-4556-a357-ef6572f17678 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-0f6e2a72-a988-49e3-8985-4e0cbb6579d6-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (04e7aff7-32b6-4398-ac1c-77497db8c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d33c7-82ff-444f-aead-e77fd3932ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d33c7-82ff-444f-aead-e77fd3932ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698201966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080da4bf-b741-437b-93a1-7fb36a8d2ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:06Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110d3fec-3f27-4092-9e1f-84cb02ef0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110d3fec-3f27-4092-9e1f-84cb02ef0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8fb067-9fb4-4b43-b5af-e2a699bbba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8fb067-9fb4-4b43-b5af-e2a699bbba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080da4bf-b741-437b-93a1-7fb36a8d2ac8', 'volume_name': 'volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54582fbf-4263-4466-b465-e8342556db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54582fbf-4263-4466-b465-e8342556db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73063c5-ddab-452c-8f66-bc38ff6f2ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:05 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Volume 080da4bf-b741-437b-93a1-7fb36a8d2ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8', 'volume_size': 1} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698201966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080da4bf-b741-437b-93a1-7fb36a8d2ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:06Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Creating volume 080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:08:05 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:08:05 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:05 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 1073741824 Aug 05 16:08:05 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:06 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 1073741824" returned: 0 in 0.407s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:06 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 Aug 05 16:08:06 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:06 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8" returned: 0 in 0.262s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73063c5-ddab-452c-8f66-bc38ff6f2ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b2428d-6116-4b9c-bd1d-123fa669d81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:06 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Volume volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 (080da4bf-b741-437b-93a1-7fb36a8d2ac8): created successfully Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b2428d-6116-4b9c-bd1d-123fa669d81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (04e7aff7-32b6-4398-ac1c-77497db8c788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:06 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c315ba6d-c91a-46d8-9dcb-fe77bb125e33 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot 64a380de-9c34-49d6-a1f1-7ca9172a5041 of volume 080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f81fee3-cd60-4006-9c6b-f1f9ab9d225a]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:06 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:06 devstack sudo[110563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 Aug 05 16:08:06 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:07 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8" returned: 0 in 0.359s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:07 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 1G Aug 05 16:08:07 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:07 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 1G" returned: 0 in 0.387s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:07 devstack sudo[110573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 Aug 05 16:08:07 devstack sudo[110573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:07 devstack sudo[110573]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041" returned: 0 in 0.284s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:07 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 is being set with open permissions: ugo+rw Aug 05 16:08:07 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:07 devstack sudo[110578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 Aug 05 16:08:07 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:08 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041" returned: 0 in 0.239s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:08 devstack sudo[110581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info Aug 05 16:08:08 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:08 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:08 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info is being set with open permissions: ugo+rw Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:08 devstack sudo[110584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info Aug 05 16:08:08 devstack sudo[110584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:08 devstack sudo[110584]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.info" returned: 0 in 0.237s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:08 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-7b27b249-4c43-457d-8fe3-4d7bc28ffdfe tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-64a380de-9c34-49d6-a1f1-7ca9172a5041-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-64a380de-9c34-49d6-a1f1-7ca9172a5041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:08 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-64a380de-9c34-49d6-a1f1-7ca9172a5041" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-64a380de-9c34-49d6-a1f1-7ca9172a5041" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot 64a380de-9c34-49d6-a1f1-7ca9172a5041 of volume 080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[1491c120-a68f-4cdc-98eb-9647aa580905]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:09 devstack sudo[110587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 Aug 05 16:08:09 devstack sudo[110587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:09 devstack sudo[110587]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041" returned: 0 in 0.349s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9738db53-6839-4850-8065-6af094dec2f4]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:09 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 Aug 05 16:08:09 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:09 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8" returned: 0 in 0.343s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:09 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:09 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 Aug 05 16:08:09 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:10 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041" returned: 0 in 0.318s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:10 devstack sudo[110603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041 Aug 05 16:08:10 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:10 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8.64a380de-9c34-49d6-a1f1-7ca9172a5041" returned: 0 in 0.247s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-64a380de-9c34-49d6-a1f1-7ca9172a5041" released by "_delete_snapshot" :: held 1.344s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" released by "delete_snapshot" :: held 1.366s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Created reservations ['ccccb52e-f205-49e3-8567-e96fad5c3059', 'ec8b54bf-8c33-4d4c-a9d6-2a662ae936bb', 'fc8320c6-04c1-458e-b89c-4b414989fbcf', 'ae5ce99e-3d61-403d-89ed-a9e27bb0778d'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:10 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:08:10 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-6ad6bd8f-49eb-4220-926d-9d6a1ad9ffed tempest-ProjectMemberTests-1210085068 None] Lock "cinder-64a380de-9c34-49d6-a1f1-7ca9172a5041-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-080da4bf-b741-437b-93a1-7fb36a8d2ac8-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "cinder-080da4bf-b741-437b-93a1-7fb36a8d2ac8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[23efde16-30c0-4a6d-a7d1-1ed886093bbe]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:11 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 Aug 05 16:08:11 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:11 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8" returned: 0 in 0.342s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:11 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8 Aug 05 16:08:11 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:11 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-080da4bf-b741-437b-93a1-7fb36a8d2ac8" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-080da4bf-b741-437b-93a1-7fb36a8d2ac8" released by "delete_volume" :: held 0.641s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Created reservations ['e2cbe058-3bb6-4c5e-b45f-5fdbf008029b', 'bdb52ebe-1004-40b6-a1f9-230310107b29', 'da1d8b49-606e-4e92-924b-f4c6a915daad', '659777e9-802d-4b69-bc3f-3732f698ddf3'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:11 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:11 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:11 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:12 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.248s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:12 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c10cc883-3d08-4cd8-a13f-3055aa8688ee tempest-ProjectMemberTests-1210085068 None] Lock "cinder-080da4bf-b741-437b-93a1-7fb36a8d2ac8-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (23517557-1d90-4a3c-b666-0bb59f2613e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba41125-7759-4c49-b53c-172af4f79a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba41125-7759-4c49-b53c-172af4f79a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39007315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e91cc0d-eedf-4e9d-a02a-f06178c039ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:13Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75679fa8-f5eb-4bea-849f-2b178cbd380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75679fa8-f5eb-4bea-849f-2b178cbd380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b941ac25-d26b-46c5-a49d-632997caad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b941ac25-d26b-46c5-a49d-632997caad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e91cc0d-eedf-4e9d-a02a-f06178c039ec', 'volume_name': 'volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d65de68-3abd-4df3-949b-0b6c05147b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d65de68-3abd-4df3-949b-0b6c05147b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5d67eb-8ad9-45fa-8054-cc4ab80d48e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:12 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Volume 2e91cc0d-eedf-4e9d-a02a-f06178c039ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec', 'volume_size': 1} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39007315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e91cc0d-eedf-4e9d-a02a-f06178c039ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bedbded092446caf0aa452d28d631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:13Z,use_quota=True,user_id='b83ac9397f1f4a3d87250d8c48735566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Creating volume 2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:08:12 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:08:12 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:12 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec 1073741824 Aug 05 16:08:12 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:13 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec 1073741824" returned: 0 in 0.402s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:13 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec Aug 05 16:08:13 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:13 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" returned: 0 in 0.240s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5d67eb-8ad9-45fa-8054-cc4ab80d48e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4d3ee9-7aff-43bf-95e6-c0334dfaabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:13 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Volume volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec (2e91cc0d-eedf-4e9d-a02a-f06178c039ec): created successfully Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4d3ee9-7aff-43bf-95e6-c0334dfaabbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Flow 'volume_create_manager' (23517557-1d90-4a3c-b666-0bb59f2613e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:13 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a27f570a-9116-42ee-bd48-074e9080dbc4 tempest-ProjectMemberTests-1210085068 None] Created volume successfully. Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Creating offline snapshot ccbc2547-6a8e-4a70-a097-f08e3aca62f6 of volume 2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377b13e-3198-4d2b-a2b5-4928a7bc95b3]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:13 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:13 devstack sudo[110627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec Aug 05 16:08:13 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:14 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 1G {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:14 devstack sudo[110632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 1G Aug 05 16:08:14 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:14 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 1G" returned: 0 in 0.382s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:14 devstack sudo[110637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 Aug 05 16:08:14 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:14 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec -F qcow2 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6" returned: 0 in 0.286s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:14 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 is being set with open permissions: ugo+rw Aug 05 16:08:14 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:14 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 Aug 05 16:08:14 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:15 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6" returned: 0 in 0.250s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:15 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info Aug 05 16:08:15 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:15 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:15 devstack cinder-volume[88715]: WARNING cinder.volume.drivers.remotefs [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info is being set with open permissions: ugo+rw Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:15 devstack sudo[110648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info Aug 05 16:08:15 devstack sudo[110648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:15 devstack sudo[110648]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.info" returned: 0 in 0.243s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:15 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:15 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-4a84f2b5-f158-4ea1-b035-bb44a5b39010 tempest-ProjectMemberTests-1210085068 None] Create snapshot completed successfully Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-ccbc2547-6a8e-4a70-a097-f08e3aca62f6-delete_snapshot" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-ccbc2547-6a8e-4a70-a097-f08e3aca62f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" by "delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-ccbc2547-6a8e-4a70-a097-f08e3aca62f6" by "_delete_snapshot" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-ccbc2547-6a8e-4a70-a097-f08e3aca62f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Deleting offline snapshot ccbc2547-6a8e-4a70-a097-f08e3aca62f6 of volume 2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] snapshot_file for this snap is: volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2473b5-d552-43b8-854f-964108a84210]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:16 devstack sudo[110651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 Aug 05 16:08:16 devstack sudo[110651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:16 devstack sudo[110651]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6" returned: 0 in 0.354s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88715) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbac35f-c33a-4991-840e-6de540d59e3c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:16 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec Aug 05 16:08:16 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:16 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" returned: 0 in 0.350s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:16 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:16 devstack sudo[110661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 Aug 05 16:08:16 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:17 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6" returned: 0 in 0.332s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:17 devstack sudo[110666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6 Aug 05 16:08:17 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:17 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec.ccbc2547-6a8e-4a70-a097-f08e3aca62f6" returned: 0 in 0.234s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-ccbc2547-6a8e-4a70-a097-f08e3aca62f6" released by "_delete_snapshot" :: held 1.359s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" released by "delete_snapshot" :: held 1.383s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Created reservations ['684fb33f-cb58-4309-8df4-82bc78543453', '59c2c957-3390-48c7-9a3c-03f1dcc50e97', 'ce0bc41a-45d1-4d5c-93f4-c6d8a17f59c8', '7dd85fe7-8de3-4653-9301-3507861cbcee'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:17 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Delete snapshot completed successfully. Aug 05 16:08:17 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-a4f3b25d-c1b5-4655-9909-74302658d161 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-ccbc2547-6a8e-4a70-a097-f08e3aca62f6-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-2e91cc0d-eedf-4e9d-a02a-f06178c039ec-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-2e91cc0d-eedf-4e9d-a02a-f06178c039ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" acquired by "delete_volume" :: waited 0.012s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa1bfd-5f24-4996-b0dd-d9d7a91458cb]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:18 devstack sudo[110669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec Aug 05 16:08:18 devstack sudo[110669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:18 devstack sudo[110669]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" returned: 0 in 0.353s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:18 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec Aug 05 16:08:18 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:18 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" returned: 0 in 0.234s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-quobyte-2e91cc0d-eedf-4e9d-a02a-f06178c039ec" released by "delete_volume" :: held 0.642s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:18 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Created reservations ['14e76e7a-b239-4a73-9d86-db6e55f7be40', '193d7d3a-328b-460e-b257-93d57dc40596', '491fdf6f-fa57-4abc-97db-fc8a79631f00', 'afad1c39-b7ca-42de-ae53-c281551b6d1b'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:19 devstack sudo[110677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:19 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:19 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.258s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:19 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Deleted volume successfully. Aug 05 16:08:19 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-f8bf6721-22a4-477d-943a-5487f7836e24 tempest-ProjectMemberTests-1210085068 None] Lock "cinder-2e91cc0d-eedf-4e9d-a02a-f06178c039ec-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Flow 'volume_create_manager' (5c67d8bc-f90f-442c-87cc-927c304088d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bce53c9-d4a3-46fc-88f5-c5f09273c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bce53c9-d4a3-46fc-88f5-c5f09273c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457360742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc4e4f0-3c78-42d3-a5c3-637eb5296735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22442b96904c88a2521d3155f47ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:23Z,use_quota=True,user_id='563e3a139966479cbde2e8c9f6753cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60284c0d-f2e4-4fe9-9ab5-deddcf4826b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60284c0d-f2e4-4fe9-9ab5-deddcf4826b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9116c970-d023-4453-b90b-c1bbde98ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9116c970-d023-4453-b90b-c1bbde98ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc4e4f0-3c78-42d3-a5c3-637eb5296735', 'volume_name': 'volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad2ed7-0cc9-43ff-bc7f-1974b07a96d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ad2ed7-0cc9-43ff-bc7f-1974b07a96d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dca682-1106-435e-b5dd-b9bb87f32406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:23 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Volume 8dc4e4f0-3c78-42d3-a5c3-637eb5296735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735', 'volume_size': 1} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457360742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc4e4f0-3c78-42d3-a5c3-637eb5296735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22442b96904c88a2521d3155f47ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:23Z,use_quota=True,user_id='563e3a139966479cbde2e8c9f6753cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Creating volume 8dc4e4f0-3c78-42d3-a5c3-637eb5296735 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:08:23 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:23 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 1073741824 Aug 05 16:08:23 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:23 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 1073741824" returned: 0 in 0.392s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:23 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:23 devstack sudo[110688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 Aug 05 16:08:23 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:24 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" returned: 0 in 0.249s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dca682-1106-435e-b5dd-b9bb87f32406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d982bf9b-97f8-4376-8183-322172f7f945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:24 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Volume volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 (8dc4e4f0-3c78-42d3-a5c3-637eb5296735): created successfully Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d982bf9b-97f8-4376-8183-322172f7f945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Flow 'volume_create_manager' (5c67d8bc-f90f-442c-87cc-927c304088d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:24 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d473219b-f1be-4505-b405-f30919b8a78f tempest-ProjectReaderTests-1735694299 None] Created volume successfully. Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Acquiring lock "cinder-8dc4e4f0-3c78-42d3-a5c3-637eb5296735-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "cinder-8dc4e4f0-3c78-42d3-a5c3-637eb5296735-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Acquiring lock "cinder-quobyte-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "cinder-quobyte-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" acquired by "delete_volume" :: waited 0.016s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d45fac-f349-4ef6-8964-4c215ca88a9c]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:24 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 Aug 05 16:08:24 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:24 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:24 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:24 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735 Aug 05 16:08:24 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:25 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "cinder-quobyte-8dc4e4f0-3c78-42d3-a5c3-637eb5296735" released by "delete_volume" :: held 0.626s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Created reservations ['40e888fb-2eff-45e6-9a1d-dc7023dd206c', '4a5a300d-463c-4f5e-b462-bcd04a7f690e', '8ed0c408-2680-49df-87f3-8cb787f4108c', 'a2420c5b-7bba-42cb-8981-5aa3bec84ee2'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:25 devstack sudo[110699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:25 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:25 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.241s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:25 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Deleted volume successfully. Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-d7df6671-e0e1-4216-9e67-5ae24910a6cc tempest-ProjectReaderTests-1735694299 None] Lock "cinder-8dc4e4f0-3c78-42d3-a5c3-637eb5296735-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88715) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 16:08:25 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Flow 'volume_create_manager' (8d5cdf63-02c9-4283-b795-13f5778f4156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0504314e-053f-4e48-89bf-1091376e6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0504314e-053f-4e48-89bf-1091376e6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791608453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2e2ffd-eab3-4bfc-b408-ec958ab24f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22442b96904c88a2521d3155f47ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:26Z,use_quota=True,user_id='563e3a139966479cbde2e8c9f6753cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de0ff22-b289-4531-9faa-abdb0097403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de0ff22-b289-4531-9faa-abdb0097403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b90fad-2fd5-4516-8e0a-5a66e68de081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b90fad-2fd5-4516-8e0a-5a66e68de081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2e2ffd-eab3-4bfc-b408-ec958ab24f54', 'volume_name': 'volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6f5ae3-8d8b-4cd9-9a36-e51d510d082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6f5ae3-8d8b-4cd9-9a36-e51d510d082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228bf980-5bb3-4bba-a76d-b5b27507e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Volume 2b2e2ffd-eab3-4bfc-b408-ec958ab24f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54', 'volume_size': 1} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791608453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2e2ffd-eab3-4bfc-b408-ec958ab24f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22442b96904c88a2521d3155f47ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T14:08:26Z,use_quota=True,user_id='563e3a139966479cbde2e8c9f6753cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051d6303-bca4-40d8-85a0-b8ba22d6b9eb),volume_type_id=051d6303-bca4-40d8-85a0-b8ba22d6b9eb)}" {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.remotefs [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Creating volume 2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 {{(pid=88715) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Selected osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 as target Quobyte volume. {{(pid=88715) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Aug 05 16:08:26 devstack cinder-volume[88715]: INFO cinder.volume.drivers.remotefs [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] casted to osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0 Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 1073741824 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:26 devstack sudo[110702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 1073741824 Aug 05 16:08:26 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:26 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 1073741824" returned: 0 in 0.422s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:26 devstack sudo[110708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 Aug 05 16:08:26 devstack sudo[110708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:26 devstack sudo[110708]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" returned: 0 in 0.238s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'} {{(pid=88715) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228bf980-5bb3-4bba-a76d-b5b27507e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54', 'volume_size': 1}' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9602044-fe04-4cdb-8c3a-92af147bee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 16:08:26 devstack cinder-volume[88715]: INFO cinder.volume.flows.manager.create_volume [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Volume volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 (2b2e2ffd-eab3-4bfc-b408-ec958ab24f54): created successfully Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9602044-fe04-4cdb-8c3a-92af147bee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88715) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 16:08:26 devstack cinder-volume[88715]: DEBUG cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Flow 'volume_create_manager' (8d5cdf63-02c9-4283-b795-13f5778f4156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88715) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 16:08:26 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-dc9ae2c8-75d6-4cb2-aa81-ffd9f22ea454 tempest-ProjectReaderTests-1735694299 None] Created volume successfully. Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Acquiring lock "cinder-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54-delete_volume" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "cinder-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Acquiring lock "cinder-quobyte-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" by "delete_volume" {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "cinder-quobyte-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" acquired by "delete_volume" :: waited 0.013s {{(pid=88715) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a93ded5-4934-4e3f-90ee-d2fd3f90e918]: (4, 'qcow2') {{(pid=89890) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:27 devstack sudo[110711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 Aug 05 16:08:27 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:27 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" returned: 0 in 0.352s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:27 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54 Aug 05 16:08:27 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:27 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833/volume-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" returned: 0 in 0.239s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "cinder-quobyte-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54" released by "delete_volume" :: held 0.627s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.quota [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Created reservations ['1aff62e1-cc67-4828-8c35-aee1214323f9', '9ee33dce-9289-40bb-a9fa-158f91ecfa23', '24be4853-3143-4421-bc82-f43b2bfee0b7', '9797cdb7-65bd-4eda-86e2-be475d8b2c91'] {{(pid=88715) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:08:27 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:08:27 devstack sudo[110719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:08:27 devstack sudo[110719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 16:08:28 devstack sudo[110719]: pam_unix(sudo:session): session closed for user root Aug 05 16:08:28 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833" returned: 0 in 0.241s {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 16:08:28 devstack cinder-volume[88715]: DEBUG cinder.manager [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Notifying Schedulers of capabilities ... {{(pid=88715) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 16:08:28 devstack cinder-volume[88715]: INFO cinder.volume.manager [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Deleted volume successfully. Aug 05 16:08:28 devstack cinder-volume[88715]: DEBUG cinder.coordination [None req-c516137d-0c0b-4b1c-a88e-96a45b31dd53 tempest-ProjectReaderTests-1735694299 None] Lock "cinder-2b2e2ffd-eab3-4bfc-b408-ec958ab24f54-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88715) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 16:08:37 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:SELECT=88,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:08:38 devstack cinder-volume[88715]: DEBUG dbcounter [-] [88715] Writing DB stats cinder:INSERT=31,cinder:UPDATE=128,cinder:SELECT=77,cinder:DELETE=10 {{(pid=88715) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG oslo_service.periodic_task [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88715) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0': None} {{(pid=88715) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG cinder.volume.drivers.quobyte [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5439a0c9-0429-4acb-a14e-59054c2806b0'] {{(pid=88715) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.lockutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88715) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 16:09:03 devstack cinder-volume[88715]: DEBUG oslo_concurrency.processutils [None req-aaeecd09-7252-41c4-81d0-6daa5afa1315 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 {{(pid=88715) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 16:09:03 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/731bf8fa2f14ac4b7c79ee15f7738833 Aug 05 16:09:03 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)